Jul 12 21:44:18.550012 ip-10-0-128-127 systemd[1]: Starting Kubernetes Kubelet... Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.017844 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023302 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023319 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023323 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023326 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023329 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023332 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023334 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 21:44:19.030590 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023337 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023340 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023345 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023349 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023352 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023355 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023358 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023360 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023363 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023365 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023368 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023371 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023373 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023376 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023379 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023381 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023384 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023390 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023393 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 21:44:19.033874 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023395 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023398 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023401 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023403 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023407 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023410 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023413 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023417 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023420 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023423 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023426 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023428 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023431 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023434 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023436 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023439 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023441 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023444 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023446 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 21:44:19.184501 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023449 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023452 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023456 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023459 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023461 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023463 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023466 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023468 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023471 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023473 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023477 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023479 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023483 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023485 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023488 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023490 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023493 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023495 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023498 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 21:44:19.186432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023500 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023511 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023514 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023518 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023521 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023523 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023526 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023529 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023532 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023534 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023537 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023541 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023543 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023546 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023548 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023551 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023554 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023557 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023560 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023563 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 21:44:19.188589 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023566 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023568 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023571 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023573 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023576 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023579 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023583 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023586 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023589 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023592 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023594 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023597 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023599 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023602 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.023605 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024388 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024396 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024401 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024405 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 21:44:19.201486 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024408 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024411 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024414 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024417 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024420 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024423 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024426 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024429 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024431 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024434 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024437 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024439 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024442 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024445 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024448 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024450 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024453 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024455 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024458 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024460 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 21:44:19.202167 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024464 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024466 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024469 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024472 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024474 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024477 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024479 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024481 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024484 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024487 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024489 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024492 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024494 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024497 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024500 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024503 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024505 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024508 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024511 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 21:44:19.203255 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024513 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024516 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024518 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024521 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024524 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024526 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024529 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024531 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024534 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024536 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024539 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024542 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024545 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024549 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024553 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024556 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024559 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024561 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024564 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024566 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 21:44:19.205453 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024569 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024571 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024574 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024577 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024579 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024582 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024585 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024587 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024590 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024593 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024596 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024599 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024601 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024604 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024606 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024609 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024612 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024614 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024617 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024619 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024623 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 21:44:19.207397 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024625 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024629 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024632 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024635 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024638 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024641 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024644 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024647 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024650 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024652 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024655 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024657 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024660 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024662 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.024665 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025067 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025073 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025076 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025079 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025081 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 21:44:19.209532 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025085 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025088 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025091 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025094 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025096 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025099 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025102 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025105 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025107 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025110 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025113 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025115 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025122 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025124 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025127 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025129 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025132 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025135 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025140 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025142 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 21:44:19.210550 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025145 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025147 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025150 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025152 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025155 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025158 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025160 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025162 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025165 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025167 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025170 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025172 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025175 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025178 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025180 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025183 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025185 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025188 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025191 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025193 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 21:44:19.212437 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025197 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025199 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025201 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025204 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025208 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025211 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025213 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025216 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025218 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025221 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025225 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025229 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025233 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025236 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025240 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025243 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025246 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025249 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025253 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 21:44:19.214071 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025256 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025259 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025261 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025264 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025267 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025271 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025274 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025278 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025281 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025283 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025286 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025289 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025291 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025293 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025296 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025298 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025301 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025304 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025307 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025310 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 21:44:19.214961 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025313 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025315 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025318 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025321 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025324 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025327 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025329 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025332 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025334 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025337 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025339 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025342 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025344 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025347 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.025349 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025423 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025434 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025440 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025444 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025451 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025454 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 12 21:44:19.215791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025458 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025463 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025466 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025469 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025472 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025476 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025479 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025482 2573 flags.go:64] FLAG: --cgroup-root="" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025486 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025489 2573 flags.go:64] FLAG: --client-ca-file="" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025492 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025495 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025499 2573 flags.go:64] FLAG: --cluster-domain="" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025502 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025507 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025510 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025513 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025518 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025521 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025524 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025527 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025531 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025534 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025536 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 12 21:44:19.216683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025540 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025542 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025546 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025549 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025552 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025555 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025558 2573 flags.go:64] FLAG: --enable-server="true" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025561 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025565 2573 flags.go:64] FLAG: --event-burst="100" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025568 2573 flags.go:64] FLAG: --event-qps="50" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025570 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025573 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025576 2573 flags.go:64] FLAG: --eviction-hard="" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025580 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025583 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025586 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025590 2573 flags.go:64] FLAG: --eviction-soft="" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025593 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025596 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025599 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025602 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025605 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025609 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025612 2573 flags.go:64] FLAG: --feature-gates="" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025617 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 12 21:44:19.218000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025620 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025625 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025628 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025632 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025635 2573 flags.go:64] FLAG: --help="false" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025638 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025641 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025644 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025646 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025650 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025653 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025656 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025659 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025662 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025664 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025667 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025671 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025673 2573 flags.go:64] FLAG: --kube-reserved="" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025676 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025679 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025682 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025685 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025705 2573 flags.go:64] FLAG: --lock-file="" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025711 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 12 21:44:19.219323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025716 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025719 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025725 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025728 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025731 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025736 2573 flags.go:64] FLAG: --logging-format="text" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025739 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025743 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025746 2573 flags.go:64] FLAG: --manifest-url="" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025749 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025754 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025758 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025762 2573 flags.go:64] FLAG: --max-pods="110" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025765 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025769 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025771 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025775 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025778 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025780 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025784 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025792 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025795 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025798 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 12 21:44:19.222942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025800 2573 flags.go:64] FLAG: --pod-cidr="" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025804 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025809 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025812 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025815 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025818 2573 flags.go:64] FLAG: --port="10250" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025821 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025824 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e87a098e1194ea5" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025828 2573 flags.go:64] FLAG: --qos-reserved="" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025832 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025835 2573 flags.go:64] FLAG: --register-node="true" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025838 2573 flags.go:64] FLAG: --register-with-taints="" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025842 2573 flags.go:64] FLAG: --registry-burst="10" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025845 2573 flags.go:64] FLAG: --registry-qps="5" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025849 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025851 2573 flags.go:64] FLAG: --reserved-memory="" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025855 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025858 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025861 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025864 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025868 2573 flags.go:64] FLAG: --runonce="false" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025871 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025874 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025877 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025880 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 12 21:44:19.224051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025883 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025886 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025889 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025892 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025895 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025898 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025901 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025904 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025907 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025910 2573 flags.go:64] FLAG: --system-cgroups="" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025912 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025917 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025920 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025922 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025926 2573 flags.go:64] FLAG: --tls-min-version="" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025929 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025933 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025936 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025939 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025942 2573 flags.go:64] FLAG: --v="2" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025946 2573 flags.go:64] FLAG: --version="false" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025952 2573 flags.go:64] FLAG: --vmodule="" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025955 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.025959 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026075 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 21:44:19.231338 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026079 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026083 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026086 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026090 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026093 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026096 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026098 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026101 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026103 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026106 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026109 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026111 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026113 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026116 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026119 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026121 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026124 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026126 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026129 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026131 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 21:44:19.232439 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026133 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026136 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026139 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026144 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026147 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026149 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026152 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026154 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026158 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026161 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026163 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026166 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026169 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026171 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026174 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026177 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026180 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026183 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026187 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026190 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 21:44:19.233341 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026192 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026196 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026198 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026201 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026203 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026206 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026208 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026211 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026213 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026216 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026218 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026221 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026224 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026226 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026228 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026232 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026234 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026237 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026239 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026242 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 21:44:19.234225 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026246 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026248 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026251 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026254 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026258 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026261 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026264 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026266 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026269 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026272 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026276 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026279 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026282 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026285 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026288 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026290 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026293 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026295 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026298 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 21:44:19.235118 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026300 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026303 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026305 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026308 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026310 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026313 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026315 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026318 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026321 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026324 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026326 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026329 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026331 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026335 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026338 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026341 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026343 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026346 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 21:44:19.236002 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.026348 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.027002 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.035992 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.036010 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.036881 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.036889 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036947 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036952 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036956 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036959 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036962 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036964 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036967 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036969 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 21:44:19.237080 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036972 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036976 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036981 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036985 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036989 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036992 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036995 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.036998 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037001 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037004 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037009 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037012 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037015 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037019 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037024 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037027 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037030 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037033 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037036 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 21:44:19.237969 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037038 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037041 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037043 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037046 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037049 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037052 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037055 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037057 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037060 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037062 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037065 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037068 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037071 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037075 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037079 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037082 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037084 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037087 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037089 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 21:44:19.238848 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037093 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037095 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037098 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037101 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037104 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037107 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037109 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037112 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037118 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037120 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037123 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037126 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037128 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037131 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037134 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037137 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037139 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037142 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037144 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037147 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 21:44:19.239737 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037150 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037153 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037155 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037158 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037160 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037163 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037165 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037168 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037171 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037174 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037176 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037178 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037181 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037184 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037187 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037189 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037192 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037194 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037196 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037200 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 21:44:19.240618 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037204 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037206 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037209 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037211 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037214 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037217 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037219 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037221 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037224 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037226 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037229 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037232 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037234 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.037239 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037358 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 21:44:19.241511 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037362 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037365 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037368 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037371 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037374 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037377 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037380 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037382 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037385 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037388 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037390 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037397 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037400 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037403 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037407 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037410 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037412 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037415 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037419 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037422 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 21:44:19.242374 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037425 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037428 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037431 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037434 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037437 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037440 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037442 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037445 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037448 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037450 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037453 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037456 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037458 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037461 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037463 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037466 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037468 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037471 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037473 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 21:44:19.243268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037476 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037478 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037481 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037483 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037486 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037489 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037491 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037496 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037499 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037501 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037504 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037508 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037511 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037514 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037516 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037519 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037522 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037524 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037527 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037530 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 21:44:19.244175 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037532 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037535 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037538 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037540 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037543 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037545 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037548 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037550 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037553 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037555 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037558 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037560 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037563 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037565 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037567 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037570 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037572 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037575 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037578 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037582 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 21:44:19.245268 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037585 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 21:44:19.245816 ip-10-0-128-127 systemd[1]: Started Kubernetes Kubelet. Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037587 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037590 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037594 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037596 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037599 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037601 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037604 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037608 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037611 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037614 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037618 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037622 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037625 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037628 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037631 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037633 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037636 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 21:44:19.246309 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:19.037639 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.037644 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.037782 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.183883 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.188573 2573 server.go:1019] "Starting client certificate rotation" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.188702 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.188739 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.191518 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.192763 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.207749 2573 log.go:25] "Validated CRI v1 runtime API" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.210448 2573 log.go:25] "Validated CRI v1 image API" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.211322 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 12 21:44:19.247512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.214729 2573 fs.go:135] Filesystem UUIDs: map[2e4bf04a-8b1a-4611-9f7c-c04888381681:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 963cdb35-ed7e-4a10-9d7e-c8b0da326ca2:/dev/nvme0n1p4] Jul 12 21:44:19.248175 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.214765 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 12 21:44:19.248175 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.218554 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.221487 2573 manager.go:216] Machine: {Timestamp:2026-07-12 21:44:19.220975805 +0000 UTC m=+0.537704077 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097923 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d10f44fe1caf172afd6e7a901548f SystemUUID:ec2d10f4-4fe1-caf1-72af-d6e7a901548f BootID:412c1aaa-8a0c-4643-8551-1de3f2358242 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bd:80:72:08:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bd:80:72:08:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:b4:1e:91:cd:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.221594 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.221675 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.223460 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.223501 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.224394 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.224408 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.224418 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.225159 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.226777 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.231737 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.231884 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.231920 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.231933 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.231954 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.231967 2573 kubelet.go:398] "Adding apiserver pod source" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.231978 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 12 21:44:19.415148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.232471 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.232491 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.235073 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237608 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237649 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237898 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237916 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237926 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237937 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237953 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.237963 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.238540 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.238549 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.238557 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.238563 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.238573 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.238582 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.239519 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.239529 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.243294 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.243307 2573 server.go:1268] "Started kubelet" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.243335 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.243396 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.244052 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.244103 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.244137 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.245577 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.246299 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.250051 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.251604 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-127.ec2.internal.18c1a8ec0f9f51f5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-127.ec2.internal,UID:ip-10-0-128-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-127.ec2.internal,},FirstTimestamp:2026-07-12 21:44:19.243274741 +0000 UTC m=+0.560003015,LastTimestamp:2026-07-12 21:44:19.243274741 +0000 UTC m=+0.560003015,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-127.ec2.internal,}" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.261451 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.262195 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.262296 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.262827 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kfndl" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.262924 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.262927 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.262950 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263033 2573 factory.go:55] Registering systemd factory Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263047 2573 factory.go:223] Registration of the systemd container factory successfully Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263066 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263071 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 12 21:44:19.415964 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263272 2573 factory.go:153] Registering CRI-O factory Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263285 2573 factory.go:223] Registration of the crio container factory successfully Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263329 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263348 2573 factory.go:103] Registering Raw factory Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263358 2573 manager.go:1196] Started watching for new ooms in manager Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.263761 2573 manager.go:349] Starting recovery of all containers Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.264273 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.264370 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.268499 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kfndl" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.271458 2573 manager.go:354] Recovery completed Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.275661 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.277681 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientMemory" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.277762 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.277773 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientPID" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.278242 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.278252 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.278266 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.278267 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.279123 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientMemory" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.279147 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.279157 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientPID" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.280190 2573 policy_none.go:49] "None policy: Start" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.280209 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.280220 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.282123 2573 policy_none.go:47] "Start" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.321274 2573 manager.go:337] "Starting Device Plugin manager" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.321302 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.321312 2573 server.go:87] "Starting device plugin registration server" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.327633 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.327650 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.327970 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.328044 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.328053 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.329066 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.329127 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.383277 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.384476 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.384508 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.384530 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.384569 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 12 21:44:19.417520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.387006 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.428752 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.429745 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientMemory" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.429775 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.429786 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientPID" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.429816 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.441628 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.441648 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-127.ec2.internal\": node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.461465 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.484966 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal"] Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.485042 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.486050 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientMemory" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.486076 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.486086 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientPID" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.488394 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.488507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.488538 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.489082 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientMemory" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.489085 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientMemory" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.489106 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.489109 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.489116 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientPID" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.489122 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientPID" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.491282 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.491308 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.492045 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientMemory" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.492072 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.492087 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeHasSufficientPID" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.520511 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-127.ec2.internal\" not found" node="ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.525045 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-127.ec2.internal\" not found" node="ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:19.561522 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.563670 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbb95fe8aa83faa678c273911aee96f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal\" (UID: \"cbb95fe8aa83faa678c273911aee96f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.563711 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbb95fe8aa83faa678c273911aee96f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal\" (UID: \"cbb95fe8aa83faa678c273911aee96f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:19.607669 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:19.563730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c0fbe03dcb71398a547458685400965-config\") pod \"kube-apiserver-proxy-ip-10-0-128-127.ec2.internal\" (UID: \"8c0fbe03dcb71398a547458685400965\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:21.271145 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.273361 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbb95fe8aa83faa678c273911aee96f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal\" (UID: \"cbb95fe8aa83faa678c273911aee96f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.273388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbb95fe8aa83faa678c273911aee96f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal\" (UID: \"cbb95fe8aa83faa678c273911aee96f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.273407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c0fbe03dcb71398a547458685400965-config\") pod \"kube-apiserver-proxy-ip-10-0-128-127.ec2.internal\" (UID: \"8c0fbe03dcb71398a547458685400965\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.273453 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbb95fe8aa83faa678c273911aee96f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal\" (UID: \"cbb95fe8aa83faa678c273911aee96f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.273459 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbb95fe8aa83faa678c273911aee96f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal\" (UID: \"cbb95fe8aa83faa678c273911aee96f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.273525 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c0fbe03dcb71398a547458685400965-config\") pod \"kube-apiserver-proxy-ip-10-0-128-127.ec2.internal\" (UID: \"8c0fbe03dcb71398a547458685400965\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.422375 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:21.371810 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:21.433001 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.432134 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.607745 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.436798 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.607745 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:21.472326 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:21.607745 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:21.572661 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:21.799634 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:21.673176 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:21.799634 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:21.773617 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:21.799634 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.793898 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 12 21:44:21.799634 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.794046 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 21:44:21.988665 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:21.873802 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-127.ec2.internal\" not found" Jul 12 21:44:21.988665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.882426 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 21:39:20 +0000 UTC" deadline="2028-04-17 18:24:44.00719111 +0000 UTC" Jul 12 21:44:21.988665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.882472 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15476h40m22.124723009s" Jul 12 21:44:21.988665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.951925 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 21:44:21.988665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.972129 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.988665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.986357 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 21:44:21.988665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.988249 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" Jul 12 21:44:21.998550 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:21.997360 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 21:44:22.170790 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.042070 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 21:44:22.170790 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.147938 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 21:44:22.170790 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:22.166772 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb95fe8aa83faa678c273911aee96f3.slice/crio-e64ed92398cc1c9653c5c7c16fceedb83c635583c2610084cbd7d6941d435a29 WatchSource:0}: Error finding container e64ed92398cc1c9653c5c7c16fceedb83c635583c2610084cbd7d6941d435a29: Status 404 returned error can't find the container with id e64ed92398cc1c9653c5c7c16fceedb83c635583c2610084cbd7d6941d435a29 Jul 12 21:44:22.170790 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:22.167103 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0fbe03dcb71398a547458685400965.slice/crio-cda75732d1915b77f7cd279eff556486771a2dbb1953922f09269ea5e99564d5 WatchSource:0}: Error finding container cda75732d1915b77f7cd279eff556486771a2dbb1953922f09269ea5e99564d5: Status 404 returned error can't find the container with id cda75732d1915b77f7cd279eff556486771a2dbb1953922f09269ea5e99564d5 Jul 12 21:44:22.174214 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.171941 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 21:44:22.747598 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.747562 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 21:44:22.843147 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.843115 2573 apiserver.go:52] "Watching apiserver" Jul 12 21:44:22.851384 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.851358 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 12 21:44:22.852606 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.852565 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-p864t","openshift-cluster-node-tuning-operator/tuned-s76lp","openshift-dns/node-resolver-wk2cf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal","openshift-multus/multus-wp54f","openshift-multus/network-metrics-daemon-65w8g","openshift-network-diagnostics/network-check-target-zgsxq","openshift-network-operator/iptables-alerter-bpvjp","kube-system/global-pull-secret-syncer-px4vm","kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx","openshift-image-registry/node-ca-jms4q","openshift-multus/multus-additional-cni-plugins-zrgtn","openshift-ovn-kubernetes/ovnkube-node-kdmth"] Jul 12 21:44:22.855190 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.855170 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:22.861950 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.858399 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.861950 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.859300 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 12 21:44:22.861950 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.859562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 12 21:44:22.861950 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.859733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-76g76\"" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.867110 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.868493 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.868825 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.869153 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qmkk\"" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.869240 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.869495 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.869818 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rclkl\"" Jul 12 21:44:22.870173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.870097 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 12 21:44:22.871038 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.871019 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 12 21:44:22.871849 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.871818 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 12 21:44:22.872201 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.872156 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 12 21:44:22.872719 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.872698 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r5dxk\"" Jul 12 21:44:22.872976 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.872949 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 12 21:44:22.873215 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.873135 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 12 21:44:22.873215 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.873203 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:22.873331 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:22.873262 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:22.874270 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.874252 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:22.874363 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:22.874312 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:22.876785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.876752 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:22.879083 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.879064 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 12 21:44:22.879176 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.879154 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kk599\"" Jul 12 21:44:22.879247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.879220 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 12 21:44:22.879247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.879238 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 12 21:44:22.879431 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.879415 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:22.879614 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:22.879596 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:22.881638 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.881250 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.884001 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.883981 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 12 21:44:22.884186 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.884169 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 12 21:44:22.884469 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.884452 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 12 21:44:22.884636 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.884617 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7jtg8\"" Jul 12 21:44:22.884763 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.884742 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:22.886247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.886209 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 21:44:22.886777 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.886756 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 12 21:44:22.887170 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.887151 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 12 21:44:22.887256 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.887197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jdhz2\"" Jul 12 21:44:22.887518 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.887434 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.887518 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.887445 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 12 21:44:22.888376 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.888354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.889037 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-cni-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889126 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:22.889126 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-modprobe-d\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.889233 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-lib-modules\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.889233 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c34a0dc-89e4-4676-8899-ba606c7a895a-cni-binary-copy\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889335 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-netns\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889335 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-hostroot\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889335 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:22.889479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acae90cb-4c9a-4030-a037-e6a9e5fc08b4-konnectivity-ca\") pod \"konnectivity-agent-p864t\" (UID: \"acae90cb-4c9a-4030-a037-e6a9e5fc08b4\") " pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:22.889479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-var-lib-kubelet\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.889479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-socket-dir-parent\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-conf-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-multus-certs\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhl58\" (UniqueName: \"kubernetes.io/projected/9a7c7e5c-17af-4c0c-9b55-894391a030dc-kube-api-access-qhl58\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-k8s-cni-cncf-io\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-cni-bin\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-cni-multus\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-kubelet\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-daemon-config\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprfj\" (UniqueName: \"kubernetes.io/projected/d6dd8535-8586-47f0-a162-11f5faae9a5a-kube-api-access-hprfj\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-etc-kubernetes\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.889767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64z54\" (UniqueName: \"kubernetes.io/projected/882769a3-67e0-400d-9f40-df2c7206dc93-kube-api-access-64z54\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889790 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysconfig\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysctl-d\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-run\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889885 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a7c7e5c-17af-4c0c-9b55-894391a030dc-tmp\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-os-release\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.889980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/4c34a0dc-89e4-4676-8899-ba606c7a895a-kube-api-access-29phr\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-host\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/882769a3-67e0-400d-9f40-df2c7206dc93-hosts-file\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-cnibin\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-systemd\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890133 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-sys\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890154 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/882769a3-67e0-400d-9f40-df2c7206dc93-tmp-dir\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890209 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acae90cb-4c9a-4030-a037-e6a9e5fc08b4-agent-certs\") pod \"konnectivity-agent-p864t\" (UID: \"acae90cb-4c9a-4030-a037-e6a9e5fc08b4\") " pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-kubernetes\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysctl-conf\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890276 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-tuned\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-system-cni-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890470 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 12 21:44:22.890647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890544 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 12 21:44:22.891008 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890659 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nlpwg\"" Jul 12 21:44:22.891008 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 12 21:44:22.891008 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890909 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 12 21:44:22.891008 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.890979 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nvjzj\"" Jul 12 21:44:22.892040 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.891387 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 12 21:44:22.892040 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.891558 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 12 21:44:22.892040 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.891572 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 12 21:44:22.892040 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.891803 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 12 21:44:22.905045 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.905014 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfcwj" Jul 12 21:44:22.911338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.911311 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfcwj" Jul 12 21:44:22.973706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.973423 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 12 21:44:22.991281 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-systemd\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.991454 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-sys\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.991454 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.991454 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvtbw\" (UniqueName: \"kubernetes.io/projected/1ec975dc-292b-49d1-9073-e1873c652db1-kube-api-access-kvtbw\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.991454 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqw8\" (UniqueName: \"kubernetes.io/projected/187e6169-df08-4441-911a-b9ed1bd19194-kube-api-access-2fqw8\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.991454 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-system-cni-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-slash\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-node-log\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/187e6169-df08-4441-911a-b9ed1bd19194-ovn-node-metrics-cert\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-conf-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-multus-certs\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-cni-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-modprobe-d\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-lib-modules\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991648 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-hostroot\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991672 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:22.991706 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991702 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acae90cb-4c9a-4030-a037-e6a9e5fc08b4-konnectivity-ca\") pod \"konnectivity-agent-p864t\" (UID: \"acae90cb-4c9a-4030-a037-e6a9e5fc08b4\") " pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhl58\" (UniqueName: \"kubernetes.io/projected/9a7c7e5c-17af-4c0c-9b55-894391a030dc-kube-api-access-qhl58\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-kubelet\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-device-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-kubelet\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991854 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-var-lib-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprfj\" (UniqueName: \"kubernetes.io/projected/d6dd8535-8586-47f0-a162-11f5faae9a5a-kube-api-access-hprfj\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991888 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-multus-certs\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-socket-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991942 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-etc-selinux\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fceae72a-b383-4da9-a08d-05093e40b365-dbus\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991989 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-systemd\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-cni-netd\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992046 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-sys\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992081 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-cni-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991821 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-conf-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.992232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.991890 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-modprobe-d\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992143 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-lib-modules\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64z54\" (UniqueName: \"kubernetes.io/projected/882769a3-67e0-400d-9f40-df2c7206dc93-kube-api-access-64z54\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992133 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-system-cni-dir\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysconfig\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992323 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-hostroot\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysctl-d\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992361 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysconfig\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992350 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-kubelet\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a7c7e5c-17af-4c0c-9b55-894391a030dc-tmp\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/4c34a0dc-89e4-4676-8899-ba606c7a895a-kube-api-access-29phr\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxnx4\" (UniqueName: \"kubernetes.io/projected/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-kube-api-access-qxnx4\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992462 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysctl-d\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-ovnkube-script-lib\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/882769a3-67e0-400d-9f40-df2c7206dc93-hosts-file\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992557 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/882769a3-67e0-400d-9f40-df2c7206dc93-hosts-file\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-cnibin\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksfjp\" (UniqueName: \"kubernetes.io/projected/dd5ad664-50df-4fab-837f-9606b29cab11-kube-api-access-ksfjp\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:22.993048 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992673 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-cnibin\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992729 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992725 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acae90cb-4c9a-4030-a037-e6a9e5fc08b4-konnectivity-ca\") pod \"konnectivity-agent-p864t\" (UID: \"acae90cb-4c9a-4030-a037-e6a9e5fc08b4\") " pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-ovnkube-config\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992846 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-env-overrides\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/882769a3-67e0-400d-9f40-df2c7206dc93-tmp-dir\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-iptables-alerter-script\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-host-slash\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-system-cni-dir\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.992991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-systemd-units\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acae90cb-4c9a-4030-a037-e6a9e5fc08b4-agent-certs\") pod \"konnectivity-agent-p864t\" (UID: \"acae90cb-4c9a-4030-a037-e6a9e5fc08b4\") " pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-kubernetes\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysctl-conf\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-tuned\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.993834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993092 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd5ad664-50df-4fab-837f-9606b29cab11-host\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd5ad664-50df-4fab-837f-9606b29cab11-serviceca\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993146 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-kubernetes\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993173 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/882769a3-67e0-400d-9f40-df2c7206dc93-tmp-dir\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-systemd\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-log-socket\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-sys-fs\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993273 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-sysctl-conf\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c34a0dc-89e4-4676-8899-ba606c7a895a-cni-binary-copy\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-netns\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-netns\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993493 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-run-netns\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-var-lib-kubelet\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-socket-dir-parent\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:22.993580 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:22.994532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993582 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-var-lib-kubelet\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-cnibin\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993612 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-socket-dir-parent\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-k8s-cni-cncf-io\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:22.993681 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:44:23.493658687 +0000 UTC m=+3.201115849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993685 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-run-k8s-cni-cncf-io\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-cni-bin\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-cni-multus\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993784 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-cni-bin\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993847 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c34a0dc-89e4-4676-8899-ba606c7a895a-cni-binary-copy\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993868 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-host-var-lib-cni-multus\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-daemon-config\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.993993 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994021 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-ovn\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-cni-bin\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-etc-kubernetes\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.995352 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994123 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-etc-kubernetes\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-registration-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b62h\" (UniqueName: \"kubernetes.io/projected/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-kube-api-access-8b62h\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-os-release\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-run\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-os-release\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994292 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c34a0dc-89e4-4676-8899-ba606c7a895a-multus-daemon-config\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fceae72a-b383-4da9-a08d-05093e40b365-kubelet-config\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-host\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994375 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-run\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-etc-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994396 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c34a0dc-89e4-4676-8899-ba606c7a895a-os-release\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:22.996104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.994434 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a7c7e5c-17af-4c0c-9b55-894391a030dc-host\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:22.999239 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:22.999171 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acae90cb-4c9a-4030-a037-e6a9e5fc08b4-agent-certs\") pod \"konnectivity-agent-p864t\" (UID: \"acae90cb-4c9a-4030-a037-e6a9e5fc08b4\") " pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:23.000239 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.000212 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a7c7e5c-17af-4c0c-9b55-894391a030dc-etc-tuned\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:23.001357 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.001335 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 21:44:23.001457 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.001437 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 21:44:23.001457 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.001453 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tn26z for pod openshift-network-diagnostics/network-check-target-zgsxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:23.001597 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.001508 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z podName:9df06cf5-c420-4cd6-b86f-336f6af35011 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:23.501490455 +0000 UTC m=+3.208947608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tn26z" (UniqueName: "kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z") pod "network-check-target-zgsxq" (UID: "9df06cf5-c420-4cd6-b86f-336f6af35011") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:23.002559 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.001850 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhl58\" (UniqueName: \"kubernetes.io/projected/9a7c7e5c-17af-4c0c-9b55-894391a030dc-kube-api-access-qhl58\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:23.002559 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.002124 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" event={"ID":"8c0fbe03dcb71398a547458685400965","Type":"ContainerStarted","Data":"cda75732d1915b77f7cd279eff556486771a2dbb1953922f09269ea5e99564d5"} Jul 12 21:44:23.002559 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.002515 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a7c7e5c-17af-4c0c-9b55-894391a030dc-tmp\") pod \"tuned-s76lp\" (UID: \"9a7c7e5c-17af-4c0c-9b55-894391a030dc\") " pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:23.004586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.004562 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprfj\" (UniqueName: \"kubernetes.io/projected/d6dd8535-8586-47f0-a162-11f5faae9a5a-kube-api-access-hprfj\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:23.004860 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.004838 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64z54\" (UniqueName: \"kubernetes.io/projected/882769a3-67e0-400d-9f40-df2c7206dc93-kube-api-access-64z54\") pod \"node-resolver-wk2cf\" (UID: \"882769a3-67e0-400d-9f40-df2c7206dc93\") " pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:23.004943 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.004867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" event={"ID":"cbb95fe8aa83faa678c273911aee96f3","Type":"ContainerStarted","Data":"e64ed92398cc1c9653c5c7c16fceedb83c635583c2610084cbd7d6941d435a29"} Jul 12 21:44:23.005757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.005713 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29phr\" (UniqueName: \"kubernetes.io/projected/4c34a0dc-89e4-4676-8899-ba606c7a895a-kube-api-access-29phr\") pod \"multus-wp54f\" (UID: \"4c34a0dc-89e4-4676-8899-ba606c7a895a\") " pod="openshift-multus/multus-wp54f" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-cni-bin\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-registration-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b62h\" (UniqueName: \"kubernetes.io/projected/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-kube-api-access-8b62h\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-os-release\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095515 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-cni-bin\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095564 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fceae72a-b383-4da9-a08d-05093e40b365-kubelet-config\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095575 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-etc-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095640 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-registration-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095642 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fceae72a-b383-4da9-a08d-05093e40b365-kubelet-config\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095674 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-etc-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095715 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-os-release\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvtbw\" (UniqueName: \"kubernetes.io/projected/1ec975dc-292b-49d1-9073-e1873c652db1-kube-api-access-kvtbw\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqw8\" (UniqueName: \"kubernetes.io/projected/187e6169-df08-4441-911a-b9ed1bd19194-kube-api-access-2fqw8\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.099551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-slash\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-node-log\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/187e6169-df08-4441-911a-b9ed1bd19194-ovn-node-metrics-cert\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095860 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-device-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095880 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-kubelet\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095901 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-var-lib-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.095986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-socket-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096011 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-slash\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-etc-selinux\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fceae72a-b383-4da9-a08d-05093e40b365-dbus\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096073 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-cni-netd\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxnx4\" (UniqueName: \"kubernetes.io/projected/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-kube-api-access-qxnx4\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096161 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-ovnkube-script-lib\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksfjp\" (UniqueName: \"kubernetes.io/projected/dd5ad664-50df-4fab-837f-9606b29cab11-kube-api-access-ksfjp\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.100524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-ovnkube-config\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-env-overrides\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096353 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-iptables-alerter-script\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-host-slash\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096393 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-cni-netd\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-system-cni-dir\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-systemd-units\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096436 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-node-log\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd5ad664-50df-4fab-837f-9606b29cab11-host\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096494 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd5ad664-50df-4fab-837f-9606b29cab11-serviceca\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096516 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-systemd\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-log-socket\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-sys-fs\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-run-netns\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.101394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-cnibin\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-ovn\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096824 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-ovn\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096867 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096890 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-system-cni-dir\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096910 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-systemd-units\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.096949 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd5ad664-50df-4fab-837f-9606b29cab11-host\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.097410 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd5ad664-50df-4fab-837f-9606b29cab11-serviceca\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.097473 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-systemd\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.097540 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-log-socket\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.097586 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-ovnkube-script-lib\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.097596 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-sys-fs\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.097671 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.097722 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret podName:fceae72a-b383-4da9-a08d-05093e40b365 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:23.59770653 +0000 UTC m=+3.305163695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret") pod "global-pull-secret-syncer-px4vm" (UID: "fceae72a-b383-4da9-a08d-05093e40b365") : object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098008 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098061 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-run-netns\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.102212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098104 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ec975dc-292b-49d1-9073-e1873c652db1-cnibin\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098272 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098327 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-run-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098369 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098522 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098805 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-ovnkube-config\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098861 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-host-slash\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.098952 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-socket-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099016 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-iptables-alerter-script\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099022 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-device-dir\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099062 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-host-kubelet\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099101 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187e6169-df08-4441-911a-b9ed1bd19194-var-lib-openvswitch\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099353 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/187e6169-df08-4441-911a-b9ed1bd19194-env-overrides\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099420 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fceae72a-b383-4da9-a08d-05093e40b365-dbus\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099482 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ec975dc-292b-49d1-9073-e1873c652db1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099518 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-etc-selinux\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.103081 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.099903 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/187e6169-df08-4441-911a-b9ed1bd19194-ovn-node-metrics-cert\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.108800 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.108701 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksfjp\" (UniqueName: \"kubernetes.io/projected/dd5ad664-50df-4fab-837f-9606b29cab11-kube-api-access-ksfjp\") pod \"node-ca-jms4q\" (UID: \"dd5ad664-50df-4fab-837f-9606b29cab11\") " pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:23.108800 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.108745 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b62h\" (UniqueName: \"kubernetes.io/projected/92eb3922-32d7-4a9d-8a9f-7bc5c690cd79-kube-api-access-8b62h\") pod \"aws-ebs-csi-driver-node-zg4vx\" (UID: \"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.108800 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.108766 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvtbw\" (UniqueName: \"kubernetes.io/projected/1ec975dc-292b-49d1-9073-e1873c652db1-kube-api-access-kvtbw\") pod \"multus-additional-cni-plugins-zrgtn\" (UID: \"1ec975dc-292b-49d1-9073-e1873c652db1\") " pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.109244 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.109222 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqw8\" (UniqueName: \"kubernetes.io/projected/187e6169-df08-4441-911a-b9ed1bd19194-kube-api-access-2fqw8\") pod \"ovnkube-node-kdmth\" (UID: \"187e6169-df08-4441-911a-b9ed1bd19194\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.110281 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.110219 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxnx4\" (UniqueName: \"kubernetes.io/projected/c0f2a691-ca96-45c0-9bde-5b2b6341ac32-kube-api-access-qxnx4\") pod \"iptables-alerter-bpvjp\" (UID: \"c0f2a691-ca96-45c0-9bde-5b2b6341ac32\") " pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:23.179297 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.179257 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:23.193803 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.193768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s76lp" Jul 12 21:44:23.204717 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.204690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wk2cf" Jul 12 21:44:23.213346 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.213323 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wp54f" Jul 12 21:44:23.222190 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.222169 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpvjp" Jul 12 21:44:23.229756 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.229735 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" Jul 12 21:44:23.238299 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.238279 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jms4q" Jul 12 21:44:23.252830 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.252811 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" Jul 12 21:44:23.259461 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.259435 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:23.499570 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.499503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:23.499700 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.499621 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:23.499700 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.499676 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:44:24.499662573 +0000 UTC m=+4.207119717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:23.600119 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.600079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:23.600318 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.600142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:23.600318 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.600252 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:23.600430 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.600320 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret podName:fceae72a-b383-4da9-a08d-05093e40b365 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:24.600301204 +0000 UTC m=+4.307758346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret") pod "global-pull-secret-syncer-px4vm" (UID: "fceae72a-b383-4da9-a08d-05093e40b365") : object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:23.600430 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.600254 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 21:44:23.600430 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.600360 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 21:44:23.600869 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.600373 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tn26z for pod openshift-network-diagnostics/network-check-target-zgsxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:23.600929 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.600916 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z podName:9df06cf5-c420-4cd6-b86f-336f6af35011 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:24.600898384 +0000 UTC m=+4.308355542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tn26z" (UniqueName: "kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z") pod "network-check-target-zgsxq" (UID: "9df06cf5-c420-4cd6-b86f-336f6af35011") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:23.914805 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.914714 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 21:39:22 +0000 UTC" deadline="2027-12-09 18:46:21.393433898 +0000 UTC" Jul 12 21:44:23.914805 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.914746 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12357h1m57.478691164s" Jul 12 21:44:23.994106 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:23.994071 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:23.994256 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:23.994204 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:24.212435 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.212401 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7c7e5c_17af_4c0c_9b55_894391a030dc.slice/crio-037c6f9933c23ceb9b08d8a5cac9c62c420dbdf6408b33a28115451442a3f793 WatchSource:0}: Error finding container 037c6f9933c23ceb9b08d8a5cac9c62c420dbdf6408b33a28115451442a3f793: Status 404 returned error can't find the container with id 037c6f9933c23ceb9b08d8a5cac9c62c420dbdf6408b33a28115451442a3f793 Jul 12 21:44:24.213939 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.213804 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec975dc_292b_49d1_9073_e1873c652db1.slice/crio-0e5253d2816a0b233452585592f3890a3b7c4db1ecbf8249a58dde106c508c56 WatchSource:0}: Error finding container 0e5253d2816a0b233452585592f3890a3b7c4db1ecbf8249a58dde106c508c56: Status 404 returned error can't find the container with id 0e5253d2816a0b233452585592f3890a3b7c4db1ecbf8249a58dde106c508c56 Jul 12 21:44:24.215738 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.215704 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882769a3_67e0_400d_9f40_df2c7206dc93.slice/crio-c7c7f90eaad9d83d6555c59101a0ff6ce5cedc074e399052bdc9dbf470c4fedd WatchSource:0}: Error finding container c7c7f90eaad9d83d6555c59101a0ff6ce5cedc074e399052bdc9dbf470c4fedd: Status 404 returned error can't find the container with id c7c7f90eaad9d83d6555c59101a0ff6ce5cedc074e399052bdc9dbf470c4fedd Jul 12 21:44:24.219620 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.219598 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c34a0dc_89e4_4676_8899_ba606c7a895a.slice/crio-84972a5b0669fe77525ea0aa4e75240f52bb7b0241ac5e8d9a98e3d9ed06038b WatchSource:0}: Error finding container 84972a5b0669fe77525ea0aa4e75240f52bb7b0241ac5e8d9a98e3d9ed06038b: Status 404 returned error can't find the container with id 84972a5b0669fe77525ea0aa4e75240f52bb7b0241ac5e8d9a98e3d9ed06038b Jul 12 21:44:24.220414 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.220393 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f2a691_ca96_45c0_9bde_5b2b6341ac32.slice/crio-ec0c4a9d9301d621ec14fc6c7815f40785b3fda7521746615e331721355941e9 WatchSource:0}: Error finding container ec0c4a9d9301d621ec14fc6c7815f40785b3fda7521746615e331721355941e9: Status 404 returned error can't find the container with id ec0c4a9d9301d621ec14fc6c7815f40785b3fda7521746615e331721355941e9 Jul 12 21:44:24.221898 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.221842 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187e6169_df08_4441_911a_b9ed1bd19194.slice/crio-34f4940ae5153fd5c2c99e119f0f63498b16353569dbdf338d966934411adfe9 WatchSource:0}: Error finding container 34f4940ae5153fd5c2c99e119f0f63498b16353569dbdf338d966934411adfe9: Status 404 returned error can't find the container with id 34f4940ae5153fd5c2c99e119f0f63498b16353569dbdf338d966934411adfe9 Jul 12 21:44:24.222617 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.222565 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5ad664_50df_4fab_837f_9606b29cab11.slice/crio-2d4d595644f923b61b6e232f5f9252f7687a2b9e4df2057b635a5aec4d309239 WatchSource:0}: Error finding container 2d4d595644f923b61b6e232f5f9252f7687a2b9e4df2057b635a5aec4d309239: Status 404 returned error can't find the container with id 2d4d595644f923b61b6e232f5f9252f7687a2b9e4df2057b635a5aec4d309239 Jul 12 21:44:24.224049 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.224020 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92eb3922_32d7_4a9d_8a9f_7bc5c690cd79.slice/crio-9f83cdf8611f5afc86981429b0d45492dbe6999a976ac295446a86218bbc51ab WatchSource:0}: Error finding container 9f83cdf8611f5afc86981429b0d45492dbe6999a976ac295446a86218bbc51ab: Status 404 returned error can't find the container with id 9f83cdf8611f5afc86981429b0d45492dbe6999a976ac295446a86218bbc51ab Jul 12 21:44:24.226039 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:24.226003 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacae90cb_4c9a_4030_a037_e6a9e5fc08b4.slice/crio-9192351e009221f000b7e99316fcb4abd4745f341c6f1ddce45398bdef2ee5c8 WatchSource:0}: Error finding container 9192351e009221f000b7e99316fcb4abd4745f341c6f1ddce45398bdef2ee5c8: Status 404 returned error can't find the container with id 9192351e009221f000b7e99316fcb4abd4745f341c6f1ddce45398bdef2ee5c8 Jul 12 21:44:24.505912 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:24.505744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:24.506033 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.505890 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:24.506033 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.505992 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:44:26.505976717 +0000 UTC m=+6.213433872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:24.606450 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:24.606415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:24.606581 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:24.606473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:24.606581 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.606575 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:24.606678 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.606579 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 21:44:24.606678 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.606600 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 21:44:24.606678 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.606613 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tn26z for pod openshift-network-diagnostics/network-check-target-zgsxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:24.606678 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.606642 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret podName:fceae72a-b383-4da9-a08d-05093e40b365 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:26.606624194 +0000 UTC m=+6.314081356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret") pod "global-pull-secret-syncer-px4vm" (UID: "fceae72a-b383-4da9-a08d-05093e40b365") : object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:24.606678 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.606658 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z podName:9df06cf5-c420-4cd6-b86f-336f6af35011 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:26.606651733 +0000 UTC m=+6.314108875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tn26z" (UniqueName: "kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z") pod "network-check-target-zgsxq" (UID: "9df06cf5-c420-4cd6-b86f-336f6af35011") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:24.916005 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:24.915815 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 21:39:22 +0000 UTC" deadline="2028-03-04 00:49:06.505898134 +0000 UTC" Jul 12 21:44:24.916005 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:24.915882 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14403h4m41.590020174s" Jul 12 21:44:24.997388 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:24.997353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:24.997544 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.997488 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:24.997905 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:24.997886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:24.998033 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:24.997992 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:25.025776 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.025739 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wp54f" event={"ID":"4c34a0dc-89e4-4676-8899-ba606c7a895a","Type":"ContainerStarted","Data":"84972a5b0669fe77525ea0aa4e75240f52bb7b0241ac5e8d9a98e3d9ed06038b"} Jul 12 21:44:25.040287 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.040004 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s76lp" event={"ID":"9a7c7e5c-17af-4c0c-9b55-894391a030dc","Type":"ContainerStarted","Data":"037c6f9933c23ceb9b08d8a5cac9c62c420dbdf6408b33a28115451442a3f793"} Jul 12 21:44:25.051785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.051086 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" event={"ID":"8c0fbe03dcb71398a547458685400965","Type":"ContainerStarted","Data":"1d3f0ec99727d00a3d4f7a9947b2d8b158803276f64b4ce7bcb7056acaea8e0b"} Jul 12 21:44:25.060216 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.060187 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p864t" event={"ID":"acae90cb-4c9a-4030-a037-e6a9e5fc08b4","Type":"ContainerStarted","Data":"9192351e009221f000b7e99316fcb4abd4745f341c6f1ddce45398bdef2ee5c8"} Jul 12 21:44:25.076029 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.075983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpvjp" event={"ID":"c0f2a691-ca96-45c0-9bde-5b2b6341ac32","Type":"ContainerStarted","Data":"ec0c4a9d9301d621ec14fc6c7815f40785b3fda7521746615e331721355941e9"} Jul 12 21:44:25.095649 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.095616 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wk2cf" event={"ID":"882769a3-67e0-400d-9f40-df2c7206dc93","Type":"ContainerStarted","Data":"c7c7f90eaad9d83d6555c59101a0ff6ce5cedc074e399052bdc9dbf470c4fedd"} Jul 12 21:44:25.104139 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.104105 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerStarted","Data":"0e5253d2816a0b233452585592f3890a3b7c4db1ecbf8249a58dde106c508c56"} Jul 12 21:44:25.113249 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.113090 2573 generic.go:356] "Generic (PLEG): container finished" podID="cbb95fe8aa83faa678c273911aee96f3" containerID="701db86ce9a4ef984931b3e616ec4731af359fde87182bcb88348e23d451d0ae" exitCode=0 Jul 12 21:44:25.113249 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.113165 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" event={"ID":"cbb95fe8aa83faa678c273911aee96f3","Type":"ContainerDied","Data":"701db86ce9a4ef984931b3e616ec4731af359fde87182bcb88348e23d451d0ae"} Jul 12 21:44:25.128454 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.128428 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" event={"ID":"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79","Type":"ContainerStarted","Data":"9f83cdf8611f5afc86981429b0d45492dbe6999a976ac295446a86218bbc51ab"} Jul 12 21:44:25.131679 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.131611 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-127.ec2.internal" podStartSLOduration=4.131580422 podStartE2EDuration="4.131580422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:25.072380541 +0000 UTC m=+4.779837706" watchObservedRunningTime="2026-07-12 21:44:25.131580422 +0000 UTC m=+4.839037587" Jul 12 21:44:25.145492 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.145331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jms4q" event={"ID":"dd5ad664-50df-4fab-837f-9606b29cab11","Type":"ContainerStarted","Data":"2d4d595644f923b61b6e232f5f9252f7687a2b9e4df2057b635a5aec4d309239"} Jul 12 21:44:25.149557 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.149503 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"34f4940ae5153fd5c2c99e119f0f63498b16353569dbdf338d966934411adfe9"} Jul 12 21:44:25.995038 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:25.995004 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:25.995511 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:25.995145 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:26.169667 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:26.169025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" event={"ID":"cbb95fe8aa83faa678c273911aee96f3","Type":"ContainerStarted","Data":"7db54a19cc03842289b3e6478ae0807ce4d9368dcc87a40fec9c479e126ffa29"} Jul 12 21:44:26.526267 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:26.526224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:26.526471 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.526389 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:26.526471 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.526460 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:44:30.526439133 +0000 UTC m=+10.233896279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:26.627237 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:26.627194 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:26.627427 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:26.627272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:26.627427 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.627410 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:26.627550 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.627476 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret podName:fceae72a-b383-4da9-a08d-05093e40b365 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:30.627458026 +0000 UTC m=+10.334915183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret") pod "global-pull-secret-syncer-px4vm" (UID: "fceae72a-b383-4da9-a08d-05093e40b365") : object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:26.627893 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.627873 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 21:44:26.627992 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.627901 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 21:44:26.627992 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.627916 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tn26z for pod openshift-network-diagnostics/network-check-target-zgsxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:26.627992 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.627973 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z podName:9df06cf5-c420-4cd6-b86f-336f6af35011 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:30.627945456 +0000 UTC m=+10.335402599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tn26z" (UniqueName: "kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z") pod "network-check-target-zgsxq" (UID: "9df06cf5-c420-4cd6-b86f-336f6af35011") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:26.995772 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:26.995697 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:26.996235 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.995840 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:26.997801 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:26.997779 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:26.997926 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:26.997885 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:27.994372 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:27.994332 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:27.994569 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:27.994474 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:28.995099 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:28.995069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:28.995552 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:28.995216 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:28.997448 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:28.997304 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:28.997448 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:28.997406 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:29.994937 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:29.994901 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:29.995139 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:29.995077 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:30.560345 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:30.560316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:30.560534 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.560444 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:30.560534 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.560490 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:44:38.560475602 +0000 UTC m=+18.267932745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:30.661433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:30.661501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.661631 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.661694 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret podName:fceae72a-b383-4da9-a08d-05093e40b365 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:38.661676598 +0000 UTC m=+18.369133745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret") pod "global-pull-secret-syncer-px4vm" (UID: "fceae72a-b383-4da9-a08d-05093e40b365") : object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.661946 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.661997 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.662011 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tn26z for pod openshift-network-diagnostics/network-check-target-zgsxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:30.662056 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.662058 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z podName:9df06cf5-c420-4cd6-b86f-336f6af35011 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:38.662042239 +0000 UTC m=+18.369499394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tn26z" (UniqueName: "kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z") pod "network-check-target-zgsxq" (UID: "9df06cf5-c420-4cd6-b86f-336f6af35011") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:30.995398 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:30.995296 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:30.995825 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.995415 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:30.995825 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:30.995784 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:30.995937 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:30.995888 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:31.994242 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:31.994211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:31.994409 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:31.994340 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:32.995032 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:32.994513 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:32.995032 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:32.994630 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:32.995032 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:32.994659 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:32.995032 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:32.994763 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:33.994424 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:33.994386 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:33.994585 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:33.994539 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:34.994755 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:34.994714 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:34.995226 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:34.994714 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:34.995226 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:34.994875 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:34.995226 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:34.994913 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:35.995035 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:35.995003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:35.995463 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:35.995121 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:36.995114 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:36.995073 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:36.995593 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:36.995222 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:36.995593 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:36.995073 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:36.995593 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:36.995362 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:37.994618 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:37.994588 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:37.994834 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:37.994693 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:38.623659 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:38.623607 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:38.624021 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.623762 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:38.624021 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.623823 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:44:54.62380774 +0000 UTC m=+34.331264882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:38.724232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:38.724199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:38.724394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:38.724244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:38.724394 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.724343 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:38.724394 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.724378 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 21:44:38.724535 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.724407 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 21:44:38.724535 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.724422 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tn26z for pod openshift-network-diagnostics/network-check-target-zgsxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:38.724535 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.724391 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret podName:fceae72a-b383-4da9-a08d-05093e40b365 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:54.724377351 +0000 UTC m=+34.431834493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret") pod "global-pull-secret-syncer-px4vm" (UID: "fceae72a-b383-4da9-a08d-05093e40b365") : object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:38.724535 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.724486 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z podName:9df06cf5-c420-4cd6-b86f-336f6af35011 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:54.724468373 +0000 UTC m=+34.431925528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tn26z" (UniqueName: "kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z") pod "network-check-target-zgsxq" (UID: "9df06cf5-c420-4cd6-b86f-336f6af35011") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:38.994894 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:38.994798 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:38.994894 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:38.994853 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:38.995122 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.994971 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:38.995122 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:38.995064 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:39.994464 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:39.994428 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:39.994872 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:39.994559 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:40.997726 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:40.997699 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:40.998212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:40.997706 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:40.998212 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:40.997794 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:40.998212 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:40.997891 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:41.994356 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:41.994323 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:41.994555 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:41.994449 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:43.000082 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.000058 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:43.000420 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.000105 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:43.000420 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:43.000168 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:43.000420 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:43.000312 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:43.206356 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.206187 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" event={"ID":"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79","Type":"ContainerStarted","Data":"720eb4f62546c02b09a242a7c5184d0f5643bbe6ecd8260cc21f592f98e7af4e"} Jul 12 21:44:43.207773 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.207747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jms4q" event={"ID":"dd5ad664-50df-4fab-837f-9606b29cab11","Type":"ContainerStarted","Data":"e9b728e0170e9534b44b7793c3a8ad2d7d62ad103ff27fd28e3ea94948be5907"} Jul 12 21:44:43.209491 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.209466 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"370f984dcfc1ce80e280e1631571606eca0a69da3262bf6998de05bac001dac0"} Jul 12 21:44:43.209602 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.209545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"d3fd6d550dd3742442383350d506f4a261bec1c3d05d31795be0705d6276a1e9"} Jul 12 21:44:43.210854 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.210827 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wp54f" event={"ID":"4c34a0dc-89e4-4676-8899-ba606c7a895a","Type":"ContainerStarted","Data":"c2947dfcf0814c2e2da92205a535b441e849cef685e7a1293e4e700cae6c33ed"} Jul 12 21:44:43.212228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.212210 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s76lp" event={"ID":"9a7c7e5c-17af-4c0c-9b55-894391a030dc","Type":"ContainerStarted","Data":"afb9d0ffa451c53bac51c4df541cec839dc041341900df4c6a007d9bdb6b3f73"} Jul 12 21:44:43.213687 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.213661 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p864t" event={"ID":"acae90cb-4c9a-4030-a037-e6a9e5fc08b4","Type":"ContainerStarted","Data":"1ddc1080707bab77485987bfb2661d2270b0d706fcc086c81507645b8e3f3b81"} Jul 12 21:44:43.215213 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.215182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wk2cf" event={"ID":"882769a3-67e0-400d-9f40-df2c7206dc93","Type":"ContainerStarted","Data":"3803ecc3a4e0f40ee1d2f4fed976b2e2083b20bdc8acf115e2c4aa711aff524b"} Jul 12 21:44:43.216824 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.216805 2573 generic.go:356] "Generic (PLEG): container finished" podID="1ec975dc-292b-49d1-9073-e1873c652db1" containerID="8d4ded446658b8bfc774b5b36c855e768e6c4aa758f92f5cdfe7de4ffcc7425e" exitCode=0 Jul 12 21:44:43.216904 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.216836 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerDied","Data":"8d4ded446658b8bfc774b5b36c855e768e6c4aa758f92f5cdfe7de4ffcc7425e"} Jul 12 21:44:43.222648 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.222608 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jms4q" podStartSLOduration=3.592561079 podStartE2EDuration="22.222596829s" totalImagesPullingTime="18.63003575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:43.222489324 +0000 UTC m=+22.929946490" watchObservedRunningTime="2026-07-12 21:44:43.222596829 +0000 UTC m=+22.930053993" Jul 12 21:44:43.223040 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.223002 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-127.ec2.internal" podStartSLOduration=22.222992977 podStartE2EDuration="22.222992977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:26.196137948 +0000 UTC m=+5.903595128" watchObservedRunningTime="2026-07-12 21:44:43.222992977 +0000 UTC m=+22.930450140" Jul 12 21:44:43.263104 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.263056 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p864t" podStartSLOduration=11.651361286 podStartE2EDuration="22.263041118s" totalImagesPullingTime="10.611679832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:43.26276666 +0000 UTC m=+22.970223818" watchObservedRunningTime="2026-07-12 21:44:43.263041118 +0000 UTC m=+22.970498282" Jul 12 21:44:43.292598 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.292541 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s76lp" podStartSLOduration=3.645626806 podStartE2EDuration="22.292525797s" totalImagesPullingTime="18.646898991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:43.277897534 +0000 UTC m=+22.985354717" watchObservedRunningTime="2026-07-12 21:44:43.292525797 +0000 UTC m=+22.999983013" Jul 12 21:44:43.292732 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.292648 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wk2cf" podStartSLOduration=3.652171381 podStartE2EDuration="22.292640898s" totalImagesPullingTime="18.640469517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:43.292196472 +0000 UTC m=+22.999653636" watchObservedRunningTime="2026-07-12 21:44:43.292640898 +0000 UTC m=+23.000098061" Jul 12 21:44:43.318317 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.318272 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wp54f" podStartSLOduration=3.617127397 podStartE2EDuration="22.318257312s" totalImagesPullingTime="18.701129915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:43.31759006 +0000 UTC m=+23.025047243" watchObservedRunningTime="2026-07-12 21:44:43.318257312 +0000 UTC m=+23.025714502" Jul 12 21:44:43.994558 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:43.994524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:43.994757 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:43.994637 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:44.221121 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.221080 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpvjp" event={"ID":"c0f2a691-ca96-45c0-9bde-5b2b6341ac32","Type":"ContainerStarted","Data":"02510a4b0772c4e1d05db13e71e5b8ef7d763f9b7feedded6f03c1b40cbfd24a"} Jul 12 21:44:44.224402 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.224373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"0fb0c7db57062fd9f94df2dbeda42ee3d193aacb4710afad70ee320139350267"} Jul 12 21:44:44.224572 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.224458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"00132012d02e275275cd885721f03192a668bc731a8d5cbaeb6cf2ae8dc32c41"} Jul 12 21:44:44.224572 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.224542 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"1909bbcb1e7eb1ba54aec061f8a8d106c20b0f0e3e2778f5f48e81072798e853"} Jul 12 21:44:44.224695 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.224614 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"4c45e5ffe8ca0d5e03bf1edca2fbe9486840e750bcfa26e024327198d8053285"} Jul 12 21:44:44.241776 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.241721 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bpvjp" podStartSLOduration=8.939723536 podStartE2EDuration="23.241701323s" totalImagesPullingTime="14.301977787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:44.241382639 +0000 UTC m=+23.948839821" watchObservedRunningTime="2026-07-12 21:44:44.241701323 +0000 UTC m=+23.949158490" Jul 12 21:44:44.478770 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.478741 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 12 21:44:44.948796 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.948618 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T21:44:44.478765245Z","UUID":"7f8fbdb8-2448-4049-ae56-a06c6bd7885c","Handler":null,"Name":"","Endpoint":""} Jul 12 21:44:44.950109 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.950091 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 12 21:44:44.950234 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.950128 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 12 21:44:44.994335 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.994308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:44.994504 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:44.994308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:44.994504 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:44.994422 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:44.994504 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:44.994484 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:45.228615 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:45.228533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" event={"ID":"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79","Type":"ContainerStarted","Data":"51a34550e67ce7a519853d23136cf5be1bec2d315f6135229f3e5963fd01e886"} Jul 12 21:44:45.994724 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:45.994643 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:45.994869 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:45.994765 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:46.234397 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:46.234365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"3ef8d5ed0f4083d9b298cbd5a9bcf30c2362b76d0a06f268d9cdfe1349023e63"} Jul 12 21:44:46.994501 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:46.994463 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:46.994697 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:46.994464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:46.994697 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:46.994602 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:46.994812 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:46.994698 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:47.994844 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:47.994686 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:47.995259 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:47.994920 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:48.001208 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.001182 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:48.001774 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.001753 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:48.242846 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.242777 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" event={"ID":"187e6169-df08-4441-911a-b9ed1bd19194","Type":"ContainerStarted","Data":"38edc603560aa10e673a3e44e8faf6efb0a41dfa3db20b2e50ffe2020eb2ab36"} Jul 12 21:44:48.243065 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.243036 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:48.244659 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.244635 2573 generic.go:356] "Generic (PLEG): container finished" podID="1ec975dc-292b-49d1-9073-e1873c652db1" containerID="be98e783d958c387f60b05ab35f39aba087b278e8286751a5caef1248df48645" exitCode=0 Jul 12 21:44:48.244745 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.244704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerDied","Data":"be98e783d958c387f60b05ab35f39aba087b278e8286751a5caef1248df48645"} Jul 12 21:44:48.244932 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.244911 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:48.245529 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.245516 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p864t" Jul 12 21:44:48.258109 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.258090 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:48.267990 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.267941 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" podStartSLOduration=8.561598179 podStartE2EDuration="27.267929563s" totalImagesPullingTime="18.706331384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:48.26785257 +0000 UTC m=+27.975309733" watchObservedRunningTime="2026-07-12 21:44:48.267929563 +0000 UTC m=+27.975386726" Jul 12 21:44:48.994704 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.994520 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:48.994890 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:48.994578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:48.994890 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:48.994799 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:48.994890 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:48.994842 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:49.248604 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:49.248515 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" event={"ID":"92eb3922-32d7-4a9d-8a9f-7bc5c690cd79","Type":"ContainerStarted","Data":"e213182cb1f10e40690ae4de55b67fe806f3a0e989171e86ea8da2d213b2d685"} Jul 12 21:44:49.249175 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:49.249150 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:49.249303 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:49.249208 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:49.263860 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:49.263838 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:44:49.265932 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:49.265898 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zg4vx" podStartSLOduration=4.555989315 podStartE2EDuration="28.265884409s" totalImagesPullingTime="23.709895094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:49.265726141 +0000 UTC m=+28.973183324" watchObservedRunningTime="2026-07-12 21:44:49.265884409 +0000 UTC m=+28.973341571" Jul 12 21:44:49.994621 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:49.994556 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:49.994839 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:49.994658 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:50.200719 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.200689 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgsxq"] Jul 12 21:44:50.201119 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.200817 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:50.201119 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:50.200911 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:50.205289 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.205264 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-65w8g"] Jul 12 21:44:50.205428 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.205369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:50.205503 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:50.205482 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:50.205859 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.205838 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px4vm"] Jul 12 21:44:50.252634 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.252550 2573 generic.go:356] "Generic (PLEG): container finished" podID="1ec975dc-292b-49d1-9073-e1873c652db1" containerID="24e2b9849539013661318efbac519d355612118967df686afbfb9dcb0f0c16a9" exitCode=0 Jul 12 21:44:50.252634 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.252625 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:50.252828 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:50.252627 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerDied","Data":"24e2b9849539013661318efbac519d355612118967df686afbfb9dcb0f0c16a9"} Jul 12 21:44:50.253116 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:50.253072 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:51.994738 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:51.994701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:51.995190 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:51.994705 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:51.995190 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:51.994836 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:51.995190 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:51.994701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:51.995190 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:51.994910 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:51.995190 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:51.994996 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:52.259604 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:52.259573 2573 generic.go:356] "Generic (PLEG): container finished" podID="1ec975dc-292b-49d1-9073-e1873c652db1" containerID="645af4c9e6b2283d255659b24b44cd451a640b9195c31e5467aca3fa0c3564ca" exitCode=0 Jul 12 21:44:52.259773 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:52.259610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerDied","Data":"645af4c9e6b2283d255659b24b44cd451a640b9195c31e5467aca3fa0c3564ca"} Jul 12 21:44:53.994378 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:53.994148 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:53.994779 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:53.994153 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:53.994779 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:53.994415 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgsxq" podUID="9df06cf5-c420-4cd6-b86f-336f6af35011" Jul 12 21:44:53.994779 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:53.994214 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:53.994779 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:53.994547 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px4vm" podUID="fceae72a-b383-4da9-a08d-05093e40b365" Jul 12 21:44:53.994779 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:53.994649 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65w8g" podUID="d6dd8535-8586-47f0-a162-11f5faae9a5a" Jul 12 21:44:54.639087 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:54.639049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:54.639255 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.639184 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:54.639255 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.639238 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:45:26.639224789 +0000 UTC m=+66.346681931 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 21:44:54.740447 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:54.740410 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:54.740638 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:54.740493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:54.740638 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.740583 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:54.740638 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.740617 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 21:44:54.740638 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.740633 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 21:44:54.740821 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.740647 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tn26z for pod openshift-network-diagnostics/network-check-target-zgsxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:54.740821 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.740670 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret podName:fceae72a-b383-4da9-a08d-05093e40b365 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:26.740647875 +0000 UTC m=+66.448105017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret") pod "global-pull-secret-syncer-px4vm" (UID: "fceae72a-b383-4da9-a08d-05093e40b365") : object "kube-system"/"original-pull-secret" not registered Jul 12 21:44:54.740821 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:54.740694 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z podName:9df06cf5-c420-4cd6-b86f-336f6af35011 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:26.740678343 +0000 UTC m=+66.448135486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tn26z" (UniqueName: "kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z") pod "network-check-target-zgsxq" (UID: "9df06cf5-c420-4cd6-b86f-336f6af35011") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 21:44:55.572394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.572366 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-127.ec2.internal" event="NodeReady" Jul 12 21:44:55.572985 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.572518 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 12 21:44:55.609723 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.609691 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-645d49dcb7-jnbzj"] Jul 12 21:44:55.614797 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.614772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.617614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.617588 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 12 21:44:55.617863 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.617818 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 12 21:44:55.617863 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.617826 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4kkf\"" Jul 12 21:44:55.618159 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.618135 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 12 21:44:55.623445 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.623270 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 12 21:44:55.627672 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.627635 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wcfn9"] Jul 12 21:44:55.633975 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.633938 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-645d49dcb7-jnbzj"] Jul 12 21:44:55.634110 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.633999 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w8j7x"] Jul 12 21:44:55.634110 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.634069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.636812 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.636793 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 12 21:44:55.636984 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.636845 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 12 21:44:55.637106 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.637088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2n9gd\"" Jul 12 21:44:55.637534 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.637516 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.639797 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.639719 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-96n4s\"" Jul 12 21:44:55.640742 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.640256 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 12 21:44:55.640742 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.640271 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 12 21:44:55.640742 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.640387 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 12 21:44:55.641217 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.641199 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wcfn9"] Jul 12 21:44:55.644502 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.644446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8j7x"] Jul 12 21:44:55.749028 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.748937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-config-volume\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.749028 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-certificates\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.749222 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.749222 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fb8ede1-b2ee-45d7-b127-69f2a42061d9-cert\") pod \"ingress-canary-w8j7x\" (UID: \"0fb8ede1-b2ee-45d7-b127-69f2a42061d9\") " pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.749222 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-tmp-dir\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.749222 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-installation-pull-secrets\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.749222 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9s4k\" (UniqueName: \"kubernetes.io/projected/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-kube-api-access-k9s4k\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.749420 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.749420 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-image-registry-private-configuration\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.749420 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/286c5551-aee4-461e-8be9-2b8f65aed5fb-ca-trust-extracted\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.749420 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-bound-sa-token\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.749420 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b88f6\" (UniqueName: \"kubernetes.io/projected/0fb8ede1-b2ee-45d7-b127-69f2a42061d9-kube-api-access-b88f6\") pod \"ingress-canary-w8j7x\" (UID: \"0fb8ede1-b2ee-45d7-b127-69f2a42061d9\") " pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.749640 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-trusted-ca\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.749640 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.749480 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76554\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-kube-api-access-76554\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.779817 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.779784 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:44:55.850212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76554\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-kube-api-access-76554\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.850378 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-config-volume\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.850378 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850260 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-certificates\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.850378 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850307 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.850378 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fb8ede1-b2ee-45d7-b127-69f2a42061d9-cert\") pod \"ingress-canary-w8j7x\" (UID: \"0fb8ede1-b2ee-45d7-b127-69f2a42061d9\") " pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.850597 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:55.850446 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 21:44:55.850597 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-tmp-dir\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.850597 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:55.850532 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls podName:d4ada1d2-c7d2-407e-8537-2991ee7cb1d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:56.350510267 +0000 UTC m=+36.057967412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls") pod "dns-default-wcfn9" (UID: "d4ada1d2-c7d2-407e-8537-2991ee7cb1d3") : secret "dns-default-metrics-tls" not found Jul 12 21:44:55.850597 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-installation-pull-secrets\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.850798 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9s4k\" (UniqueName: \"kubernetes.io/projected/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-kube-api-access-k9s4k\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.850798 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.850798 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-image-registry-private-configuration\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.850798 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/286c5551-aee4-461e-8be9-2b8f65aed5fb-ca-trust-extracted\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.850798 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-bound-sa-token\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.850798 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850750 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b88f6\" (UniqueName: \"kubernetes.io/projected/0fb8ede1-b2ee-45d7-b127-69f2a42061d9-kube-api-access-b88f6\") pod \"ingress-canary-w8j7x\" (UID: \"0fb8ede1-b2ee-45d7-b127-69f2a42061d9\") " pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.851091 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:55.850833 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 21:44:55.851091 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:55.850847 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645d49dcb7-jnbzj: secret "image-registry-tls" not found Jul 12 21:44:55.851091 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.850880 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-tmp-dir\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.851091 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:55.850947 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls podName:286c5551-aee4-461e-8be9-2b8f65aed5fb nodeName:}" failed. No retries permitted until 2026-07-12 21:44:56.350929731 +0000 UTC m=+36.058386890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls") pod "image-registry-645d49dcb7-jnbzj" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb") : secret "image-registry-tls" not found Jul 12 21:44:55.851291 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.851133 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-certificates\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.851291 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.851212 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/286c5551-aee4-461e-8be9-2b8f65aed5fb-ca-trust-extracted\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.851291 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.851216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-trusted-ca\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.851629 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.851604 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-config-volume\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.852118 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.852090 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-trusted-ca\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.855409 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.855383 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-image-registry-private-configuration\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.855532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.855391 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-installation-pull-secrets\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.855532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.855419 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fb8ede1-b2ee-45d7-b127-69f2a42061d9-cert\") pod \"ingress-canary-w8j7x\" (UID: \"0fb8ede1-b2ee-45d7-b127-69f2a42061d9\") " pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.859692 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.859666 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-bound-sa-token\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.860036 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.860014 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76554\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-kube-api-access-76554\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:55.860105 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.860061 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9s4k\" (UniqueName: \"kubernetes.io/projected/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-kube-api-access-k9s4k\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:55.860498 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.860475 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b88f6\" (UniqueName: \"kubernetes.io/projected/0fb8ede1-b2ee-45d7-b127-69f2a42061d9-kube-api-access-b88f6\") pod \"ingress-canary-w8j7x\" (UID: \"0fb8ede1-b2ee-45d7-b127-69f2a42061d9\") " pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.871260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.871235 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:44:55.953592 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.953560 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8j7x" Jul 12 21:44:55.994065 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.994026 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:44:55.994243 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.994027 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:44:55.994243 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.994026 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:44:55.997160 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.997125 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 21:44:55.997160 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.997128 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8xfd\"" Jul 12 21:44:55.997362 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.997189 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 21:44:55.997362 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.997223 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qc82f\"" Jul 12 21:44:55.997362 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.997251 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 21:44:55.997533 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:55.997520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 21:44:56.292010 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:56.291783 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8j7x"] Jul 12 21:44:56.295897 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:44:56.295873 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb8ede1_b2ee_45d7_b127_69f2a42061d9.slice/crio-e181fe08e5ec32f6bb76216a50326b293897a8f3cd8e5e4a604ff01556aac513 WatchSource:0}: Error finding container e181fe08e5ec32f6bb76216a50326b293897a8f3cd8e5e4a604ff01556aac513: Status 404 returned error can't find the container with id e181fe08e5ec32f6bb76216a50326b293897a8f3cd8e5e4a604ff01556aac513 Jul 12 21:44:56.356273 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:56.356244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:56.356407 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:56.356350 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:56.356446 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:56.356416 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 21:44:56.356446 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:56.356433 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645d49dcb7-jnbzj: secret "image-registry-tls" not found Jul 12 21:44:56.356446 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:56.356438 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 21:44:56.356533 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:56.356493 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls podName:286c5551-aee4-461e-8be9-2b8f65aed5fb nodeName:}" failed. No retries permitted until 2026-07-12 21:44:57.356478703 +0000 UTC m=+37.063935849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls") pod "image-registry-645d49dcb7-jnbzj" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb") : secret "image-registry-tls" not found Jul 12 21:44:56.356533 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:56.356508 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls podName:d4ada1d2-c7d2-407e-8537-2991ee7cb1d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:57.356501663 +0000 UTC m=+37.063958805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls") pod "dns-default-wcfn9" (UID: "d4ada1d2-c7d2-407e-8537-2991ee7cb1d3") : secret "dns-default-metrics-tls" not found Jul 12 21:44:57.274904 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:57.274821 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8j7x" event={"ID":"0fb8ede1-b2ee-45d7-b127-69f2a42061d9","Type":"ContainerStarted","Data":"e181fe08e5ec32f6bb76216a50326b293897a8f3cd8e5e4a604ff01556aac513"} Jul 12 21:44:57.278129 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:57.278096 2573 generic.go:356] "Generic (PLEG): container finished" podID="1ec975dc-292b-49d1-9073-e1873c652db1" containerID="4e926b35d7360284d871e837e1f02bb32f5e181600fa1a0a37ee11b5ccae7723" exitCode=0 Jul 12 21:44:57.278269 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:57.278161 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerDied","Data":"4e926b35d7360284d871e837e1f02bb32f5e181600fa1a0a37ee11b5ccae7723"} Jul 12 21:44:57.364855 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:57.364815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:57.365013 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:57.364999 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 21:44:57.365075 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:57.365011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:57.365075 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:57.365068 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls podName:d4ada1d2-c7d2-407e-8537-2991ee7cb1d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:44:59.365048599 +0000 UTC m=+39.072505744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls") pod "dns-default-wcfn9" (UID: "d4ada1d2-c7d2-407e-8537-2991ee7cb1d3") : secret "dns-default-metrics-tls" not found Jul 12 21:44:57.365194 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:57.365182 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 21:44:57.365229 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:57.365201 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645d49dcb7-jnbzj: secret "image-registry-tls" not found Jul 12 21:44:57.365262 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:57.365255 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls podName:286c5551-aee4-461e-8be9-2b8f65aed5fb nodeName:}" failed. No retries permitted until 2026-07-12 21:44:59.365235587 +0000 UTC m=+39.072692749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls") pod "image-registry-645d49dcb7-jnbzj" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb") : secret "image-registry-tls" not found Jul 12 21:44:58.283137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:58.283107 2573 generic.go:356] "Generic (PLEG): container finished" podID="1ec975dc-292b-49d1-9073-e1873c652db1" containerID="1c796330622997cfc286a3d8173e563808ce03fb3f2c2ee39b1b40b4e2758406" exitCode=0 Jul 12 21:44:58.283512 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:58.283175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerDied","Data":"1c796330622997cfc286a3d8173e563808ce03fb3f2c2ee39b1b40b4e2758406"} Jul 12 21:44:59.286548 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.286512 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8j7x" event={"ID":"0fb8ede1-b2ee-45d7-b127-69f2a42061d9","Type":"ContainerStarted","Data":"d858895da5bca59bec4fe07cd23d0222abde3c311b826fdfcb3886998e723873"} Jul 12 21:44:59.289869 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.289842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" event={"ID":"1ec975dc-292b-49d1-9073-e1873c652db1","Type":"ContainerStarted","Data":"2ab4e860f0003872e048febda73ee56d87fd503d0418281a75cbaaa63dbb4ac0"} Jul 12 21:44:59.302320 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.302282 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w8j7x" podStartSLOduration=2.323328597 podStartE2EDuration="4.302267545s" totalImagesPullingTime="1.978938948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:59.30178559 +0000 UTC m=+39.009242768" watchObservedRunningTime="2026-07-12 21:44:59.302267545 +0000 UTC m=+39.009724825" Jul 12 21:44:59.323431 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.323382 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zrgtn" podStartSLOduration=9.298526419 podStartE2EDuration="38.323361371s" totalImagesPullingTime="29.024834952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:44:59.321898908 +0000 UTC m=+39.029356072" watchObservedRunningTime="2026-07-12 21:44:59.323361371 +0000 UTC m=+39.030818535" Jul 12 21:44:59.383203 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.383032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:44:59.383365 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:59.383161 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 21:44:59.383365 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:59.383281 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls podName:d4ada1d2-c7d2-407e-8537-2991ee7cb1d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:03.383261718 +0000 UTC m=+43.090718864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls") pod "dns-default-wcfn9" (UID: "d4ada1d2-c7d2-407e-8537-2991ee7cb1d3") : secret "dns-default-metrics-tls" not found Jul 12 21:44:59.383365 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.383325 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:44:59.383510 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:59.383420 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 21:44:59.383510 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:59.383432 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645d49dcb7-jnbzj: secret "image-registry-tls" not found Jul 12 21:44:59.383510 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:44:59.383472 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls podName:286c5551-aee4-461e-8be9-2b8f65aed5fb nodeName:}" failed. No retries permitted until 2026-07-12 21:45:03.383460054 +0000 UTC m=+43.090917199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls") pod "image-registry-645d49dcb7-jnbzj" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb") : secret "image-registry-tls" not found Jul 12 21:44:59.443100 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.443061 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:44:59.543358 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:44:59.543231 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:45:00.866289 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:00.866256 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:45:00.926633 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:00.926602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:45:02.349152 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:02.349118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:45:02.448895 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:02.448862 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" limit=1024 Jul 12 21:45:03.413100 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:03.413065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:45:03.413100 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:03.413111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:45:03.413488 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:03.413229 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 21:45:03.413488 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:03.413297 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls podName:d4ada1d2-c7d2-407e-8537-2991ee7cb1d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:11.413278904 +0000 UTC m=+51.120736046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls") pod "dns-default-wcfn9" (UID: "d4ada1d2-c7d2-407e-8537-2991ee7cb1d3") : secret "dns-default-metrics-tls" not found Jul 12 21:45:03.413488 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:03.413230 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 21:45:03.413488 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:03.413330 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645d49dcb7-jnbzj: secret "image-registry-tls" not found Jul 12 21:45:03.413488 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:03.413370 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls podName:286c5551-aee4-461e-8be9-2b8f65aed5fb nodeName:}" failed. No retries permitted until 2026-07-12 21:45:11.41335948 +0000 UTC m=+51.120816621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls") pod "image-registry-645d49dcb7-jnbzj" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb") : secret "image-registry-tls" not found Jul 12 21:45:11.469351 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:11.469306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:45:11.469351 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:11.469357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:45:11.469808 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:11.469445 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 21:45:11.469808 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:11.469522 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls podName:d4ada1d2-c7d2-407e-8537-2991ee7cb1d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:27.469505274 +0000 UTC m=+67.176962416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls") pod "dns-default-wcfn9" (UID: "d4ada1d2-c7d2-407e-8537-2991ee7cb1d3") : secret "dns-default-metrics-tls" not found Jul 12 21:45:11.469808 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:11.469453 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 21:45:11.469808 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:11.469551 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645d49dcb7-jnbzj: secret "image-registry-tls" not found Jul 12 21:45:11.469808 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:11.469600 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls podName:286c5551-aee4-461e-8be9-2b8f65aed5fb nodeName:}" failed. No retries permitted until 2026-07-12 21:45:27.46958805 +0000 UTC m=+67.177045191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls") pod "image-registry-645d49dcb7-jnbzj" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb") : secret "image-registry-tls" not found Jul 12 21:45:21.265280 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:21.265253 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdmth" Jul 12 21:45:23.214418 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.214386 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq"] Jul 12 21:45:23.216795 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.216775 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:23.219053 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.219025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 12 21:45:23.219053 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.219045 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b7s7s\"" Jul 12 21:45:23.219940 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.219924 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 12 21:45:23.219940 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.219935 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 12 21:45:23.225528 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.225507 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq"] Jul 12 21:45:23.247191 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.247166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:23.247323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.247207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s65j\" (UniqueName: \"kubernetes.io/projected/0e131a74-427c-4fc9-a5e1-ed33ad443948-kube-api-access-4s65j\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:23.323400 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.323368 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-vtsnp"] Jul 12 21:45:23.324985 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.324951 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:23.327525 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.327498 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 12 21:45:23.327933 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.327917 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 12 21:45:23.328071 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.328053 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jgfv9\"" Jul 12 21:45:23.332011 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.331992 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw"] Jul 12 21:45:23.333783 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.333768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.336151 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.336132 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 12 21:45:23.336401 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.336386 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5g5xc\"" Jul 12 21:45:23.336533 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.336517 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 12 21:45:23.338019 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.337996 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-vtsnp"] Jul 12 21:45:23.338123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.338066 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 12 21:45:23.338123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.338080 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 12 21:45:23.348241 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348215 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw"] Jul 12 21:45:23.348395 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:23.348437 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.348472 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:23.348521 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348473 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:23.348521 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.348512 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 21:45:23.348587 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s65j\" (UniqueName: \"kubernetes.io/projected/0e131a74-427c-4fc9-a5e1-ed33ad443948-kube-api-access-4s65j\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:23.348587 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.348561 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls podName:0e131a74-427c-4fc9-a5e1-ed33ad443948 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:23.848546864 +0000 UTC m=+63.556004006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls") pod "cluster-samples-operator-65db858894-bmzrq" (UID: "0e131a74-427c-4fc9-a5e1-ed33ad443948") : secret "samples-operator-tls" not found Jul 12 21:45:23.348656 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcdjp\" (UniqueName: \"kubernetes.io/projected/92277741-3de3-40e8-96b0-99108a3fff36-kube-api-access-fcdjp\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.348733 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.348713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92277741-3de3-40e8-96b0-99108a3fff36-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.380358 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.380327 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s65j\" (UniqueName: \"kubernetes.io/projected/0e131a74-427c-4fc9-a5e1-ed33ad443948-kube-api-access-4s65j\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:23.450462 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.450421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcdjp\" (UniqueName: \"kubernetes.io/projected/92277741-3de3-40e8-96b0-99108a3fff36-kube-api-access-fcdjp\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.450997 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.450908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92277741-3de3-40e8-96b0-99108a3fff36-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.451136 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.451091 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.451203 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.451180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:23.451252 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.451226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:23.452105 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.452079 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:23.452947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.452923 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92277741-3de3-40e8-96b0-99108a3fff36-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.453077 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.453061 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:23.453249 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.453237 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls podName:92277741-3de3-40e8-96b0-99108a3fff36 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:23.953208155 +0000 UTC m=+63.660665308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rg4xw" (UID: "92277741-3de3-40e8-96b0-99108a3fff36") : secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:23.453565 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.453550 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 21:45:23.453634 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.453605 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert podName:dd8d4ee9-68e7-4544-a7e1-0a7b344d771d nodeName:}" failed. No retries permitted until 2026-07-12 21:45:23.953591463 +0000 UTC m=+63.661048611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vtsnp" (UID: "dd8d4ee9-68e7-4544-a7e1-0a7b344d771d") : secret "networking-console-plugin-cert" not found Jul 12 21:45:23.465654 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.465601 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcdjp\" (UniqueName: \"kubernetes.io/projected/92277741-3de3-40e8-96b0-99108a3fff36-kube-api-access-fcdjp\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.853841 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.853810 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:23.854012 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.853976 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 21:45:23.854057 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.854048 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls podName:0e131a74-427c-4fc9-a5e1-ed33ad443948 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:24.854032232 +0000 UTC m=+64.561489374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls") pod "cluster-samples-operator-65db858894-bmzrq" (UID: "0e131a74-427c-4fc9-a5e1-ed33ad443948") : secret "samples-operator-tls" not found Jul 12 21:45:23.954332 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.954295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:23.954332 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:23.954338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:23.954532 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.954454 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:23.954532 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.954529 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls podName:92277741-3de3-40e8-96b0-99108a3fff36 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:24.95451383 +0000 UTC m=+64.661970973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rg4xw" (UID: "92277741-3de3-40e8-96b0-99108a3fff36") : secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:23.954605 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.954462 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 21:45:23.954637 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:23.954607 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert podName:dd8d4ee9-68e7-4544-a7e1-0a7b344d771d nodeName:}" failed. No retries permitted until 2026-07-12 21:45:24.954592211 +0000 UTC m=+64.662049371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vtsnp" (UID: "dd8d4ee9-68e7-4544-a7e1-0a7b344d771d") : secret "networking-console-plugin-cert" not found Jul 12 21:45:24.860491 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:24.860455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:24.860883 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:24.860578 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 21:45:24.860883 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:24.860630 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls podName:0e131a74-427c-4fc9-a5e1-ed33ad443948 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:26.860616526 +0000 UTC m=+66.568073668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls") pod "cluster-samples-operator-65db858894-bmzrq" (UID: "0e131a74-427c-4fc9-a5e1-ed33ad443948") : secret "samples-operator-tls" not found Jul 12 21:45:24.961813 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:24.961767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:24.961943 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:24.961832 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:24.961943 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:24.961925 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:24.962038 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:24.962001 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls podName:92277741-3de3-40e8-96b0-99108a3fff36 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:26.961985968 +0000 UTC m=+66.669443113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rg4xw" (UID: "92277741-3de3-40e8-96b0-99108a3fff36") : secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:24.962038 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:24.961930 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 21:45:24.962104 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:24.962054 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert podName:dd8d4ee9-68e7-4544-a7e1-0a7b344d771d nodeName:}" failed. No retries permitted until 2026-07-12 21:45:26.962042889 +0000 UTC m=+66.669500031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vtsnp" (UID: "dd8d4ee9-68e7-4544-a7e1-0a7b344d771d") : secret "networking-console-plugin-cert" not found Jul 12 21:45:26.676370 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.676332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:45:26.679207 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.679187 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 21:45:26.687219 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.687197 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 12 21:45:26.687293 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.687259 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs podName:d6dd8535-8586-47f0-a162-11f5faae9a5a nodeName:}" failed. No retries permitted until 2026-07-12 21:46:30.687241693 +0000 UTC m=+130.394698836 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs") pod "network-metrics-daemon-65w8g" (UID: "d6dd8535-8586-47f0-a162-11f5faae9a5a") : secret "metrics-daemon-secret" not found Jul 12 21:45:26.777015 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.776957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:45:26.777178 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.777088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:45:26.779566 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.779548 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 21:45:26.779771 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.779752 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 21:45:26.789657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.789634 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fceae72a-b383-4da9-a08d-05093e40b365-original-pull-secret\") pod \"global-pull-secret-syncer-px4vm\" (UID: \"fceae72a-b383-4da9-a08d-05093e40b365\") " pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:45:26.789751 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.789740 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 21:45:26.800879 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.800857 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn26z\" (UniqueName: \"kubernetes.io/projected/9df06cf5-c420-4cd6-b86f-336f6af35011-kube-api-access-tn26z\") pod \"network-check-target-zgsxq\" (UID: \"9df06cf5-c420-4cd6-b86f-336f6af35011\") " pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:45:26.877421 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.877381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:26.877591 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.877540 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 21:45:26.877630 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.877604 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls podName:0e131a74-427c-4fc9-a5e1-ed33ad443948 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:30.87758837 +0000 UTC m=+70.585045512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls") pod "cluster-samples-operator-65db858894-bmzrq" (UID: "0e131a74-427c-4fc9-a5e1-ed33ad443948") : secret "samples-operator-tls" not found Jul 12 21:45:26.908784 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.908750 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qc82f\"" Jul 12 21:45:26.917010 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.916989 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:45:26.919269 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.919253 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px4vm" Jul 12 21:45:26.978153 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.978122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:26.978288 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:26.978164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:26.978288 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.978263 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:26.978405 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.978334 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls podName:92277741-3de3-40e8-96b0-99108a3fff36 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:30.978318185 +0000 UTC m=+70.685775330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rg4xw" (UID: "92277741-3de3-40e8-96b0-99108a3fff36") : secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:26.978405 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.978263 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 21:45:26.978405 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:26.978403 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert podName:dd8d4ee9-68e7-4544-a7e1-0a7b344d771d nodeName:}" failed. No retries permitted until 2026-07-12 21:45:30.978389507 +0000 UTC m=+70.685846649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vtsnp" (UID: "dd8d4ee9-68e7-4544-a7e1-0a7b344d771d") : secret "networking-console-plugin-cert" not found Jul 12 21:45:27.075158 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:27.075124 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgsxq"] Jul 12 21:45:27.079597 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:27.079559 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df06cf5_c420_4cd6_b86f_336f6af35011.slice/crio-8eadd4882af1abdd55724965374225401094aae9f37e6f68eccee4fb07672928 WatchSource:0}: Error finding container 8eadd4882af1abdd55724965374225401094aae9f37e6f68eccee4fb07672928: Status 404 returned error can't find the container with id 8eadd4882af1abdd55724965374225401094aae9f37e6f68eccee4fb07672928 Jul 12 21:45:27.096926 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:27.096905 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px4vm"] Jul 12 21:45:27.100238 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:27.100217 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfceae72a_b383_4da9_a08d_05093e40b365.slice/crio-0727133e3a5804b4d24e4a62b5334dc8cd684ff3cde93e4ab4ba70d70bafce71 WatchSource:0}: Error finding container 0727133e3a5804b4d24e4a62b5334dc8cd684ff3cde93e4ab4ba70d70bafce71: Status 404 returned error can't find the container with id 0727133e3a5804b4d24e4a62b5334dc8cd684ff3cde93e4ab4ba70d70bafce71 Jul 12 21:45:27.356475 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:27.356444 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px4vm" event={"ID":"fceae72a-b383-4da9-a08d-05093e40b365","Type":"ContainerStarted","Data":"0727133e3a5804b4d24e4a62b5334dc8cd684ff3cde93e4ab4ba70d70bafce71"} Jul 12 21:45:27.357585 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:27.357564 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgsxq" event={"ID":"9df06cf5-c420-4cd6-b86f-336f6af35011","Type":"ContainerStarted","Data":"8eadd4882af1abdd55724965374225401094aae9f37e6f68eccee4fb07672928"} Jul 12 21:45:27.481689 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:27.481649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:45:27.481869 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:27.481704 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:45:27.481869 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:27.481795 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 21:45:27.481998 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:27.481866 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 21:45:27.481998 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:27.481884 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645d49dcb7-jnbzj: secret "image-registry-tls" not found Jul 12 21:45:27.481998 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:27.481876 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls podName:d4ada1d2-c7d2-407e-8537-2991ee7cb1d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:59.481846644 +0000 UTC m=+99.189303791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls") pod "dns-default-wcfn9" (UID: "d4ada1d2-c7d2-407e-8537-2991ee7cb1d3") : secret "dns-default-metrics-tls" not found Jul 12 21:45:27.481998 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:27.481941 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls podName:286c5551-aee4-461e-8be9-2b8f65aed5fb nodeName:}" failed. No retries permitted until 2026-07-12 21:45:59.481924842 +0000 UTC m=+99.189381987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls") pod "image-registry-645d49dcb7-jnbzj" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb") : secret "image-registry-tls" not found Jul 12 21:45:28.653771 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.653723 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9x9bt"] Jul 12 21:45:28.667635 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.667605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.670527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.670454 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9x9bt"] Jul 12 21:45:28.676083 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.676059 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 12 21:45:28.676371 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.676353 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7xs2t\"" Jul 12 21:45:28.677516 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.677496 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 12 21:45:28.677756 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.677732 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 12 21:45:28.677993 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.677956 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 12 21:45:28.691407 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.691382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94624b5d-31dc-4643-95ec-85f3c7ea6756-data-volume\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.691526 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.691418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.691526 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.691455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94624b5d-31dc-4643-95ec-85f3c7ea6756-crio-socket\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.691526 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.691482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.691682 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.691576 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46cw6\" (UniqueName: \"kubernetes.io/projected/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-api-access-46cw6\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793027 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.792989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94624b5d-31dc-4643-95ec-85f3c7ea6756-data-volume\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793236 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.793048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793236 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.793082 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94624b5d-31dc-4643-95ec-85f3c7ea6756-crio-socket\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793236 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.793104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793236 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.793137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46cw6\" (UniqueName: \"kubernetes.io/projected/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-api-access-46cw6\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793452 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.793278 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94624b5d-31dc-4643-95ec-85f3c7ea6756-data-volume\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793452 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.793241 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94624b5d-31dc-4643-95ec-85f3c7ea6756-crio-socket\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:28.793452 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:28.793347 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 21:45:28.793452 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:28.793446 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 21:45:28.793643 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:28.793456 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:29.293414716 +0000 UTC m=+69.000871871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : configmap "kube-rbac-proxy" not found Jul 12 21:45:28.793643 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:28.793504 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:29.29348809 +0000 UTC m=+69.000945263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : secret "insights-runtime-extractor-tls" not found Jul 12 21:45:28.802126 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:28.802096 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46cw6\" (UniqueName: \"kubernetes.io/projected/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-api-access-46cw6\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:29.299376 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:29.299335 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:29.299688 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:29.299417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:29.299688 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:29.299493 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 21:45:29.299688 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:29.299588 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 21:45:29.299688 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:29.299610 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:30.299586893 +0000 UTC m=+70.007044042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : configmap "kube-rbac-proxy" not found Jul 12 21:45:29.299688 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:29.299666 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:30.299646083 +0000 UTC m=+70.007103228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : secret "insights-runtime-extractor-tls" not found Jul 12 21:45:30.309804 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:30.309755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:30.310281 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:30.309814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:30.310281 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:30.309878 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 21:45:30.310281 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:30.309971 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:32.309937193 +0000 UTC m=+72.017394336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : configmap "kube-rbac-proxy" not found Jul 12 21:45:30.310281 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:30.309993 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 21:45:30.310281 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:30.310059 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:32.31004223 +0000 UTC m=+72.017499388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : secret "insights-runtime-extractor-tls" not found Jul 12 21:45:30.822485 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:30.822455 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wk2cf_882769a3-67e0-400d-9f40-df2c7206dc93/dns-node-resolver/0.log" Jul 12 21:45:30.916054 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:30.915980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:30.916248 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:30.916181 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 21:45:30.916321 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:30.916261 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls podName:0e131a74-427c-4fc9-a5e1-ed33ad443948 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:38.916243278 +0000 UTC m=+78.623700443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls") pod "cluster-samples-operator-65db858894-bmzrq" (UID: "0e131a74-427c-4fc9-a5e1-ed33ad443948") : secret "samples-operator-tls" not found Jul 12 21:45:31.016818 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:31.016776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:31.017016 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:31.016836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:31.017016 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:31.016921 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:31.017016 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:31.017016 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls podName:92277741-3de3-40e8-96b0-99108a3fff36 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:39.016992996 +0000 UTC m=+78.724450150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rg4xw" (UID: "92277741-3de3-40e8-96b0-99108a3fff36") : secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:31.017174 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:31.016924 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 21:45:31.017174 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:31.017067 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert podName:dd8d4ee9-68e7-4544-a7e1-0a7b344d771d nodeName:}" failed. No retries permitted until 2026-07-12 21:45:39.017052228 +0000 UTC m=+78.724509371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vtsnp" (UID: "dd8d4ee9-68e7-4544-a7e1-0a7b344d771d") : secret "networking-console-plugin-cert" not found Jul 12 21:45:31.423500 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:31.423467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jms4q_dd5ad664-50df-4fab-837f-9606b29cab11/node-ca/0.log" Jul 12 21:45:32.327901 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.327862 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:32.327901 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.327907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:32.328170 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:32.328019 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 21:45:32.328170 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:32.328018 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 21:45:32.328170 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:32.328068 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:36.32805343 +0000 UTC m=+76.035510572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : secret "insights-runtime-extractor-tls" not found Jul 12 21:45:32.328170 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:32.328105 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:36.328089619 +0000 UTC m=+76.035546760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : configmap "kube-rbac-proxy" not found Jul 12 21:45:32.373364 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.373328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px4vm" event={"ID":"fceae72a-b383-4da9-a08d-05093e40b365","Type":"ContainerStarted","Data":"02abfb2aea643a590fc56ec7e44d1237a2e4c1276d4bca96b31a05a24f7fb62e"} Jul 12 21:45:32.374745 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.374722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgsxq" event={"ID":"9df06cf5-c420-4cd6-b86f-336f6af35011","Type":"ContainerStarted","Data":"f1bc05519bd7c63554b7fa778a952120e43be331550d050b222bfc2957c380a2"} Jul 12 21:45:32.374872 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.374858 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:45:32.391463 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.391413 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-px4vm" podStartSLOduration=66.98129629 podStartE2EDuration="1m11.391397174s" totalImagesPullingTime="4.410100884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:32.390878779 +0000 UTC m=+72.098335943" watchObservedRunningTime="2026-07-12 21:45:32.391397174 +0000 UTC m=+72.098854341" Jul 12 21:45:32.409292 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.409249 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zgsxq" podStartSLOduration=66.983386291 podStartE2EDuration="1m11.409234012s" totalImagesPullingTime="4.425847721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:32.408890961 +0000 UTC m=+72.116348135" watchObservedRunningTime="2026-07-12 21:45:32.409234012 +0000 UTC m=+72.116691154" Jul 12 21:45:32.422568 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:32.422547 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8j7x_0fb8ede1-b2ee-45d7-b127-69f2a42061d9/serve-healthcheck-canary/0.log" Jul 12 21:45:36.358149 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:36.358106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:36.358149 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:36.358149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:36.358563 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:36.358234 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 21:45:36.358563 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:36.358261 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 21:45:36.358563 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:36.358310 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:44.358286543 +0000 UTC m=+84.065743686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : configmap "kube-rbac-proxy" not found Jul 12 21:45:36.358563 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:36.358325 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls podName:94624b5d-31dc-4643-95ec-85f3c7ea6756 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:44.358318566 +0000 UTC m=+84.065775708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x9bt" (UID: "94624b5d-31dc-4643-95ec-85f3c7ea6756") : secret "insights-runtime-extractor-tls" not found Jul 12 21:45:38.979587 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:38.979546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:38.981940 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:38.981913 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e131a74-427c-4fc9-a5e1-ed33ad443948-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bmzrq\" (UID: \"0e131a74-427c-4fc9-a5e1-ed33ad443948\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:39.080576 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:39.080540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:39.080781 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:39.080596 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:39.080781 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:39.080694 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:39.080781 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:39.080710 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 21:45:39.080781 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:39.080762 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls podName:92277741-3de3-40e8-96b0-99108a3fff36 nodeName:}" failed. No retries permitted until 2026-07-12 21:45:55.08074516 +0000 UTC m=+94.788202302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rg4xw" (UID: "92277741-3de3-40e8-96b0-99108a3fff36") : secret "cluster-monitoring-operator-tls" not found Jul 12 21:45:39.080781 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:45:39.080777 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert podName:dd8d4ee9-68e7-4544-a7e1-0a7b344d771d nodeName:}" failed. No retries permitted until 2026-07-12 21:45:55.080770631 +0000 UTC m=+94.788227773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vtsnp" (UID: "dd8d4ee9-68e7-4544-a7e1-0a7b344d771d") : secret "networking-console-plugin-cert" not found Jul 12 21:45:39.126525 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:39.126485 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" Jul 12 21:45:39.248691 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:39.248618 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq"] Jul 12 21:45:39.392924 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:39.392889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" event={"ID":"0e131a74-427c-4fc9-a5e1-ed33ad443948","Type":"ContainerStarted","Data":"176ccc1254d111de98f2726641320843ba6581390e60c15ef35abab851ae4f5a"} Jul 12 21:45:41.399926 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:41.399887 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" event={"ID":"0e131a74-427c-4fc9-a5e1-ed33ad443948","Type":"ContainerStarted","Data":"1a94e06e455d8b08331f643162dd6eaf1269403db072221592b7018eb200804d"} Jul 12 21:45:41.400438 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:41.399950 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" event={"ID":"0e131a74-427c-4fc9-a5e1-ed33ad443948","Type":"ContainerStarted","Data":"fe01ebb861382c231d003a7dc107f3253ecf48e5f6c183796a0c458e4e8aef98"} Jul 12 21:45:41.415759 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:41.415712 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bmzrq" podStartSLOduration=17.010306095 podStartE2EDuration="18.415698436s" totalImagesPullingTime="1.405392341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:41.414589791 +0000 UTC m=+81.122046955" watchObservedRunningTime="2026-07-12 21:45:41.415698436 +0000 UTC m=+81.123155599" Jul 12 21:45:44.422205 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:44.422099 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:44.422205 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:44.422138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:44.422673 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:44.422643 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94624b5d-31dc-4643-95ec-85f3c7ea6756-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:44.424323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:44.424306 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94624b5d-31dc-4643-95ec-85f3c7ea6756-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x9bt\" (UID: \"94624b5d-31dc-4643-95ec-85f3c7ea6756\") " pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:44.581716 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:44.581682 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9x9bt" Jul 12 21:45:44.709697 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:44.707554 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9x9bt"] Jul 12 21:45:44.713632 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:44.713607 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94624b5d_31dc_4643_95ec_85f3c7ea6756.slice/crio-e15140df2cd0782b91a13902bf4cb7db6e72dba7fd9c6a838a2b9fbd9875c2b3 WatchSource:0}: Error finding container e15140df2cd0782b91a13902bf4cb7db6e72dba7fd9c6a838a2b9fbd9875c2b3: Status 404 returned error can't find the container with id e15140df2cd0782b91a13902bf4cb7db6e72dba7fd9c6a838a2b9fbd9875c2b3 Jul 12 21:45:45.411896 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:45.411851 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x9bt" event={"ID":"94624b5d-31dc-4643-95ec-85f3c7ea6756","Type":"ContainerStarted","Data":"e15140df2cd0782b91a13902bf4cb7db6e72dba7fd9c6a838a2b9fbd9875c2b3"} Jul 12 21:45:49.424123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:49.424083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x9bt" event={"ID":"94624b5d-31dc-4643-95ec-85f3c7ea6756","Type":"ContainerStarted","Data":"a2da9d5b3281ec6a69a3c64aac15ae7068aafbcaabe106806b65ba8ecbd6c9a7"} Jul 12 21:45:49.424593 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:49.424145 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x9bt" event={"ID":"94624b5d-31dc-4643-95ec-85f3c7ea6756","Type":"ContainerStarted","Data":"e7bb2bb4e388d8888122a7f8f916e576e84cc3c1c64165ae9b5c3ffc6e3b6c86"} Jul 12 21:45:52.075985 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.075932 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq"] Jul 12 21:45:52.079154 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.079131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.081584 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.081561 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 12 21:45:52.082567 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.082543 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 12 21:45:52.082673 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.082549 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4chz5\"" Jul 12 21:45:52.082673 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.082547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 12 21:45:52.082673 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.082594 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 12 21:45:52.090202 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.090180 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq"] Jul 12 21:45:52.190251 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.190214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d30e8144-3db4-44a1-8a20-bf20ea860bb8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f4667d8d-wgdzq\" (UID: \"d30e8144-3db4-44a1-8a20-bf20ea860bb8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.190435 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.190359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmbfl\" (UniqueName: \"kubernetes.io/projected/d30e8144-3db4-44a1-8a20-bf20ea860bb8-kube-api-access-rmbfl\") pod \"managed-serviceaccount-addon-agent-69f4667d8d-wgdzq\" (UID: \"d30e8144-3db4-44a1-8a20-bf20ea860bb8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.291341 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.291305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d30e8144-3db4-44a1-8a20-bf20ea860bb8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f4667d8d-wgdzq\" (UID: \"d30e8144-3db4-44a1-8a20-bf20ea860bb8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.291544 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.291522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmbfl\" (UniqueName: \"kubernetes.io/projected/d30e8144-3db4-44a1-8a20-bf20ea860bb8-kube-api-access-rmbfl\") pod \"managed-serviceaccount-addon-agent-69f4667d8d-wgdzq\" (UID: \"d30e8144-3db4-44a1-8a20-bf20ea860bb8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.293814 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.293794 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d30e8144-3db4-44a1-8a20-bf20ea860bb8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f4667d8d-wgdzq\" (UID: \"d30e8144-3db4-44a1-8a20-bf20ea860bb8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.302484 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.302464 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmbfl\" (UniqueName: \"kubernetes.io/projected/d30e8144-3db4-44a1-8a20-bf20ea860bb8-kube-api-access-rmbfl\") pod \"managed-serviceaccount-addon-agent-69f4667d8d-wgdzq\" (UID: \"d30e8144-3db4-44a1-8a20-bf20ea860bb8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.402603 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.402573 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" Jul 12 21:45:52.435645 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.435601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x9bt" event={"ID":"94624b5d-31dc-4643-95ec-85f3c7ea6756","Type":"ContainerStarted","Data":"bb47872ad9aa08b9f711eb22284585785f6b75c0f54f7184551d6252231e31f6"} Jul 12 21:45:52.455370 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.455174 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9x9bt" podStartSLOduration=17.865704752 podStartE2EDuration="24.455150014s" totalImagesPullingTime="6.589445262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:45:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:52.455123993 +0000 UTC m=+92.162581157" watchObservedRunningTime="2026-07-12 21:45:52.455150014 +0000 UTC m=+92.162607180" Jul 12 21:45:52.528881 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:52.528845 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq"] Jul 12 21:45:52.532436 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:52.532398 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd30e8144_3db4_44a1_8a20_bf20ea860bb8.slice/crio-60a38461ec44949ef69d2624c3ff4a10abfc9ade9a3da0b2cb4ea3f1c8a178d2 WatchSource:0}: Error finding container 60a38461ec44949ef69d2624c3ff4a10abfc9ade9a3da0b2cb4ea3f1c8a178d2: Status 404 returned error can't find the container with id 60a38461ec44949ef69d2624c3ff4a10abfc9ade9a3da0b2cb4ea3f1c8a178d2 Jul 12 21:45:53.441319 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:53.441260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" event={"ID":"d30e8144-3db4-44a1-8a20-bf20ea860bb8","Type":"ContainerStarted","Data":"60a38461ec44949ef69d2624c3ff4a10abfc9ade9a3da0b2cb4ea3f1c8a178d2"} Jul 12 21:45:55.114797 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.114700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:55.114797 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.114741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:55.117123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.117098 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd8d4ee9-68e7-4544-a7e1-0a7b344d771d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vtsnp\" (UID: \"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:55.117231 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.117180 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92277741-3de3-40e8-96b0-99108a3fff36-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rg4xw\" (UID: \"92277741-3de3-40e8-96b0-99108a3fff36\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:55.135025 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.135002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" Jul 12 21:45:55.143042 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.143024 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" Jul 12 21:45:55.265387 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.265352 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-vtsnp"] Jul 12 21:45:55.268800 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:55.268769 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8d4ee9_68e7_4544_a7e1_0a7b344d771d.slice/crio-9328e8c76619f2a7184fad27e0aa5e67943dc931a7a613458a4cd4816302e7bc WatchSource:0}: Error finding container 9328e8c76619f2a7184fad27e0aa5e67943dc931a7a613458a4cd4816302e7bc: Status 404 returned error can't find the container with id 9328e8c76619f2a7184fad27e0aa5e67943dc931a7a613458a4cd4816302e7bc Jul 12 21:45:55.281169 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.281146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw"] Jul 12 21:45:55.283686 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:55.283661 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92277741_3de3_40e8_96b0_99108a3fff36.slice/crio-176e1c263765e3910cd9781629639c36dd60cb5a56580c9137711bf9c946f81c WatchSource:0}: Error finding container 176e1c263765e3910cd9781629639c36dd60cb5a56580c9137711bf9c946f81c: Status 404 returned error can't find the container with id 176e1c263765e3910cd9781629639c36dd60cb5a56580c9137711bf9c946f81c Jul 12 21:45:55.448616 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.448527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" event={"ID":"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d","Type":"ContainerStarted","Data":"9328e8c76619f2a7184fad27e0aa5e67943dc931a7a613458a4cd4816302e7bc"} Jul 12 21:45:55.449935 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.449908 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" event={"ID":"d30e8144-3db4-44a1-8a20-bf20ea860bb8","Type":"ContainerStarted","Data":"f4c2bc6070371a6dfb840d46ff5ead16f37e41a1ae6be5f78d789100c1125687"} Jul 12 21:45:55.450991 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.450955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" event={"ID":"92277741-3de3-40e8-96b0-99108a3fff36","Type":"ContainerStarted","Data":"176e1c263765e3910cd9781629639c36dd60cb5a56580c9137711bf9c946f81c"} Jul 12 21:45:55.468696 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:55.468653 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f4667d8d-wgdzq" podStartSLOduration=1.162486725 podStartE2EDuration="3.468638629s" totalImagesPullingTime="2.306151904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:55.468156899 +0000 UTC m=+95.175614076" watchObservedRunningTime="2026-07-12 21:45:55.468638629 +0000 UTC m=+95.176095793" Jul 12 21:45:57.300630 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.300594 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s"] Jul 12 21:45:57.304007 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.303986 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" Jul 12 21:45:57.306374 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.306350 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 12 21:45:57.306484 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.306392 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-b5gcs\"" Jul 12 21:45:57.317648 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.317626 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s"] Jul 12 21:45:57.436885 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.436839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/71fc858c-48f0-4366-92b0-f6b21fad9b81-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fqh7s\" (UID: \"71fc858c-48f0-4366-92b0-f6b21fad9b81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" Jul 12 21:45:57.461435 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.461400 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" event={"ID":"92277741-3de3-40e8-96b0-99108a3fff36","Type":"ContainerStarted","Data":"ee62eda09ccae28260c614b866544b1498c954db49a16735e251c2e04a24d6be"} Jul 12 21:45:57.462989 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.462952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" event={"ID":"dd8d4ee9-68e7-4544-a7e1-0a7b344d771d","Type":"ContainerStarted","Data":"0f00bbe3d93f5ef0c109b215a23810b9df4c5f62eed527eaaa55e95fcce49168"} Jul 12 21:45:57.480689 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.480645 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rg4xw" podStartSLOduration=32.960077092 podStartE2EDuration="34.480628205s" totalImagesPullingTime="1.520551113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:57.479612761 +0000 UTC m=+97.187069952" watchObservedRunningTime="2026-07-12 21:45:57.480628205 +0000 UTC m=+97.188085348" Jul 12 21:45:57.495431 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.495381 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-vtsnp" podStartSLOduration=32.963989704 podStartE2EDuration="34.495361928s" totalImagesPullingTime="1.531372224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:57.494597562 +0000 UTC m=+97.202054745" watchObservedRunningTime="2026-07-12 21:45:57.495361928 +0000 UTC m=+97.202819093" Jul 12 21:45:57.537973 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.537925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/71fc858c-48f0-4366-92b0-f6b21fad9b81-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fqh7s\" (UID: \"71fc858c-48f0-4366-92b0-f6b21fad9b81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" Jul 12 21:45:57.540514 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.540480 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/71fc858c-48f0-4366-92b0-f6b21fad9b81-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fqh7s\" (UID: \"71fc858c-48f0-4366-92b0-f6b21fad9b81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" Jul 12 21:45:57.613334 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.613298 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" Jul 12 21:45:57.755726 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:57.755686 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s"] Jul 12 21:45:57.759398 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:57.759371 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fc858c_48f0_4366_92b0_f6b21fad9b81.slice/crio-0f55900ed9d49655797dd95ece6c5bbee9b69b90acdba44ff578f31aa9d4133a WatchSource:0}: Error finding container 0f55900ed9d49655797dd95ece6c5bbee9b69b90acdba44ff578f31aa9d4133a: Status 404 returned error can't find the container with id 0f55900ed9d49655797dd95ece6c5bbee9b69b90acdba44ff578f31aa9d4133a Jul 12 21:45:58.469105 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:58.468472 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" event={"ID":"71fc858c-48f0-4366-92b0-f6b21fad9b81","Type":"ContainerStarted","Data":"0f55900ed9d49655797dd95ece6c5bbee9b69b90acdba44ff578f31aa9d4133a"} Jul 12 21:45:59.473289 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.473248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" event={"ID":"71fc858c-48f0-4366-92b0-f6b21fad9b81","Type":"ContainerStarted","Data":"8d507d7a60577990ca7c231b3547414570805884c83e6166d608b0b208995893"} Jul 12 21:45:59.473767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.473456 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" Jul 12 21:45:59.478164 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.478141 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" Jul 12 21:45:59.488558 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.488517 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fqh7s" podStartSLOduration=1.544330032 podStartE2EDuration="2.488504928s" totalImagesPullingTime="944.174896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:45:59.4874518 +0000 UTC m=+99.194908974" watchObservedRunningTime="2026-07-12 21:45:59.488504928 +0000 UTC m=+99.195962092" Jul 12 21:45:59.552547 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.552519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:45:59.552713 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.552581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:45:59.554859 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.554839 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ada1d2-c7d2-407e-8537-2991ee7cb1d3-metrics-tls\") pod \"dns-default-wcfn9\" (UID: \"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3\") " pod="openshift-dns/dns-default-wcfn9" Jul 12 21:45:59.555021 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.555004 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"image-registry-645d49dcb7-jnbzj\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:45:59.830342 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.830313 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4kkf\"" Jul 12 21:45:59.838065 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.838051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:45:59.848361 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.848330 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2n9gd\"" Jul 12 21:45:59.856596 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.856572 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcfn9" Jul 12 21:45:59.973229 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.973202 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-645d49dcb7-jnbzj"] Jul 12 21:45:59.975571 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:59.975535 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286c5551_aee4_461e_8be9_2b8f65aed5fb.slice/crio-2b4c05f4aa14778698637b2f83d25b63e645cfc41552a2d5200c8ca4a53c10ba WatchSource:0}: Error finding container 2b4c05f4aa14778698637b2f83d25b63e645cfc41552a2d5200c8ca4a53c10ba: Status 404 returned error can't find the container with id 2b4c05f4aa14778698637b2f83d25b63e645cfc41552a2d5200c8ca4a53c10ba Jul 12 21:45:59.986799 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:45:59.986772 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wcfn9"] Jul 12 21:45:59.990929 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:45:59.990905 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ada1d2_c7d2_407e_8537_2991ee7cb1d3.slice/crio-01402aa31f52bb1f3de1a328f26ca433f3630cd6ae0a91b7e2151161808e7184 WatchSource:0}: Error finding container 01402aa31f52bb1f3de1a328f26ca433f3630cd6ae0a91b7e2151161808e7184: Status 404 returned error can't find the container with id 01402aa31f52bb1f3de1a328f26ca433f3630cd6ae0a91b7e2151161808e7184 Jul 12 21:46:00.361321 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.361283 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-s2htg"] Jul 12 21:46:00.364612 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.364589 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.367446 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.367427 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 12 21:46:00.367564 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.367519 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 12 21:46:00.368579 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.368556 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 12 21:46:00.368683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.368620 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6hddg\"" Jul 12 21:46:00.381242 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.381221 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-s2htg"] Jul 12 21:46:00.459859 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.459806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpz48\" (UniqueName: \"kubernetes.io/projected/be56b2b8-3b07-4239-b026-5730cedb09cc-kube-api-access-xpz48\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.460045 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.459877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.460045 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.459912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be56b2b8-3b07-4239-b026-5730cedb09cc-metrics-client-ca\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.460155 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.460041 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.478114 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.478072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcfn9" event={"ID":"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3","Type":"ContainerStarted","Data":"01402aa31f52bb1f3de1a328f26ca433f3630cd6ae0a91b7e2151161808e7184"} Jul 12 21:46:00.479657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.479588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" event={"ID":"286c5551-aee4-461e-8be9-2b8f65aed5fb","Type":"ContainerStarted","Data":"f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476"} Jul 12 21:46:00.479657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.479639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" event={"ID":"286c5551-aee4-461e-8be9-2b8f65aed5fb","Type":"ContainerStarted","Data":"2b4c05f4aa14778698637b2f83d25b63e645cfc41552a2d5200c8ca4a53c10ba"} Jul 12 21:46:00.514700 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.514646 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" podStartSLOduration=99.514623067 podStartE2EDuration="1m39.514623067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:00.513452994 +0000 UTC m=+100.220910159" watchObservedRunningTime="2026-07-12 21:46:00.514623067 +0000 UTC m=+100.222080232" Jul 12 21:46:00.560683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.560646 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.560893 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.560696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be56b2b8-3b07-4239-b026-5730cedb09cc-metrics-client-ca\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.560893 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.560766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.560893 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.560815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpz48\" (UniqueName: \"kubernetes.io/projected/be56b2b8-3b07-4239-b026-5730cedb09cc-kube-api-access-xpz48\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.561129 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:46:00.560927 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 12 21:46:00.561129 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:46:00.561031 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-tls podName:be56b2b8-3b07-4239-b026-5730cedb09cc nodeName:}" failed. No retries permitted until 2026-07-12 21:46:01.061008155 +0000 UTC m=+100.768465300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-tls") pod "prometheus-operator-64785b6675-s2htg" (UID: "be56b2b8-3b07-4239-b026-5730cedb09cc") : secret "prometheus-operator-tls" not found Jul 12 21:46:00.561587 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.561559 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be56b2b8-3b07-4239-b026-5730cedb09cc-metrics-client-ca\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.563660 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.563635 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:00.569795 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:00.569776 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpz48\" (UniqueName: \"kubernetes.io/projected/be56b2b8-3b07-4239-b026-5730cedb09cc-kube-api-access-xpz48\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:01.064754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:01.064720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:01.067229 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:01.067200 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be56b2b8-3b07-4239-b026-5730cedb09cc-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-s2htg\" (UID: \"be56b2b8-3b07-4239-b026-5730cedb09cc\") " pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:01.274027 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:01.273992 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" Jul 12 21:46:01.502451 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:01.502415 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:46:01.631508 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:01.631476 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-s2htg"] Jul 12 21:46:01.799749 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:01.799676 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe56b2b8_3b07_4239_b026_5730cedb09cc.slice/crio-5be7a254e66f96585b6b33a7fecaf3792fdfc10de908f05feb0180b895096715 WatchSource:0}: Error finding container 5be7a254e66f96585b6b33a7fecaf3792fdfc10de908f05feb0180b895096715: Status 404 returned error can't find the container with id 5be7a254e66f96585b6b33a7fecaf3792fdfc10de908f05feb0180b895096715 Jul 12 21:46:02.508320 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:02.508280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcfn9" event={"ID":"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3","Type":"ContainerStarted","Data":"a868d6ba379bd128208d342560b1c4f57928d8a3fa91d0f222ef916537220c6c"} Jul 12 21:46:02.508767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:02.508348 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcfn9" event={"ID":"d4ada1d2-c7d2-407e-8537-2991ee7cb1d3","Type":"ContainerStarted","Data":"42bbe373f5e287d627d2596ac247509cadd342a6e92c2b44433b4206de5777a8"} Jul 12 21:46:02.508767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:02.508379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wcfn9" Jul 12 21:46:02.509677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:02.509646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" event={"ID":"be56b2b8-3b07-4239-b026-5730cedb09cc","Type":"ContainerStarted","Data":"5be7a254e66f96585b6b33a7fecaf3792fdfc10de908f05feb0180b895096715"} Jul 12 21:46:02.539458 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:02.539404 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wcfn9" podStartSLOduration=65.704713835 podStartE2EDuration="1m7.53938396s" totalImagesPullingTime="1.834670125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:02.538610782 +0000 UTC m=+102.246067966" watchObservedRunningTime="2026-07-12 21:46:02.53938396 +0000 UTC m=+102.246841125" Jul 12 21:46:03.053210 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.053175 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566645b487-85s5d"] Jul 12 21:46:03.069163 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.069132 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566645b487-85s5d"] Jul 12 21:46:03.069313 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.069283 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.072322 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.072071 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tdltj\"" Jul 12 21:46:03.072322 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.072104 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 12 21:46:03.072322 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.072075 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 12 21:46:03.072584 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.072380 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 12 21:46:03.074080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.073865 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 12 21:46:03.074080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.073912 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 12 21:46:03.074080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.073928 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 12 21:46:03.074510 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.074398 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 12 21:46:03.185495 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.185459 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-service-ca\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.185495 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.185496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-oauth-config\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.185733 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.185522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-oauth-serving-cert\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.185733 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.185618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-serving-cert\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.185733 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.185646 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-config\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.185733 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.185662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlph\" (UniqueName: \"kubernetes.io/projected/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-kube-api-access-9xlph\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.286268 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.286232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-serving-cert\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.286453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.286276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-config\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.286453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.286293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlph\" (UniqueName: \"kubernetes.io/projected/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-kube-api-access-9xlph\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.286453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.286317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-service-ca\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.286453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.286332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-oauth-config\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.286453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.286356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-oauth-serving-cert\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.287091 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.287069 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-service-ca\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.287179 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.287113 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-oauth-serving-cert\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.287212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.287190 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-config\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.288778 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.288758 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-serving-cert\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.288850 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.288765 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-oauth-config\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.294641 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.294622 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlph\" (UniqueName: \"kubernetes.io/projected/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-kube-api-access-9xlph\") pod \"console-566645b487-85s5d\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.379390 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.379356 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zgsxq" Jul 12 21:46:03.380777 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.380759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:03.654807 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:03.654780 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566645b487-85s5d"] Jul 12 21:46:03.658886 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:03.658864 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd12a32_9de2_44ee_bb0f_a65a53f95cdd.slice/crio-208bcceb24dd6689e39d74cbcd3dec7e72919c4b7d2fad2ac9d4f7118dafe5ad WatchSource:0}: Error finding container 208bcceb24dd6689e39d74cbcd3dec7e72919c4b7d2fad2ac9d4f7118dafe5ad: Status 404 returned error can't find the container with id 208bcceb24dd6689e39d74cbcd3dec7e72919c4b7d2fad2ac9d4f7118dafe5ad Jul 12 21:46:04.519126 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:04.519086 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" event={"ID":"be56b2b8-3b07-4239-b026-5730cedb09cc","Type":"ContainerStarted","Data":"542f189f9a569b133099e51ef26dc9841aa6a1035c2bae3736e4a69e4593a794"} Jul 12 21:46:04.519308 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:04.519151 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" event={"ID":"be56b2b8-3b07-4239-b026-5730cedb09cc","Type":"ContainerStarted","Data":"2976fec7825667efd278a2aebb23d9e89246e68fe2020c7003f2b500ecee65fa"} Jul 12 21:46:04.520485 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:04.520453 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566645b487-85s5d" event={"ID":"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd","Type":"ContainerStarted","Data":"208bcceb24dd6689e39d74cbcd3dec7e72919c4b7d2fad2ac9d4f7118dafe5ad"} Jul 12 21:46:04.537267 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:04.537219 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-s2htg" podStartSLOduration=2.827710664 podStartE2EDuration="4.537202646s" totalImagesPullingTime="1.709491982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:04.536131927 +0000 UTC m=+104.243589115" watchObservedRunningTime="2026-07-12 21:46:04.537202646 +0000 UTC m=+104.244659810" Jul 12 21:46:06.529873 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.529788 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566645b487-85s5d" event={"ID":"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd","Type":"ContainerStarted","Data":"f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d"} Jul 12 21:46:06.552665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.552613 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566645b487-85s5d" podStartSLOduration=0.978818177 podStartE2EDuration="3.552598311s" totalImagesPullingTime="2.573780134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:06.55167535 +0000 UTC m=+106.259132514" watchObservedRunningTime="2026-07-12 21:46:06.552598311 +0000 UTC m=+106.260055476" Jul 12 21:46:06.730506 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.730474 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4qznq"] Jul 12 21:46:06.733893 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.733871 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.735997 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.735977 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 12 21:46:06.736099 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.736013 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 12 21:46:06.736099 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.735983 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 12 21:46:06.736177 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.736057 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x8mls\"" Jul 12 21:46:06.915073 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-textfile\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915073 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np4n6\" (UniqueName: \"kubernetes.io/projected/b4922907-52ae-46fd-b200-3505a5a5fada-kube-api-access-np4n6\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915300 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-wtmp\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915300 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-tls\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915300 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915300 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-sys\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915300 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4922907-52ae-46fd-b200-3505a5a5fada-metrics-client-ca\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915300 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-root\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:06.915483 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:06.915313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016165 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016134 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-wtmp\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016165 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016169 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-tls\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016414 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016414 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016303 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-wtmp\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016414 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:46:07.016315 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 12 21:46:07.016414 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016344 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-sys\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016414 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016375 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-sys\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016414 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:46:07.016381 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-tls podName:b4922907-52ae-46fd-b200-3505a5a5fada nodeName:}" failed. No retries permitted until 2026-07-12 21:46:07.516359075 +0000 UTC m=+107.223816236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-tls") pod "node-exporter-4qznq" (UID: "b4922907-52ae-46fd-b200-3505a5a5fada") : secret "node-exporter-tls" not found Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4922907-52ae-46fd-b200-3505a5a5fada-metrics-client-ca\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-root\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-textfile\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np4n6\" (UniqueName: \"kubernetes.io/projected/b4922907-52ae-46fd-b200-3505a5a5fada-kube-api-access-np4n6\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016597 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4922907-52ae-46fd-b200-3505a5a5fada-root\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016842 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016894 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4922907-52ae-46fd-b200-3505a5a5fada-metrics-client-ca\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.016942 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.016927 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-textfile\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.018773 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.018754 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.026711 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.026687 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np4n6\" (UniqueName: \"kubernetes.io/projected/b4922907-52ae-46fd-b200-3505a5a5fada-kube-api-access-np4n6\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.521682 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.521648 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-tls\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.523945 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.523924 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4922907-52ae-46fd-b200-3505a5a5fada-node-exporter-tls\") pod \"node-exporter-4qznq\" (UID: \"b4922907-52ae-46fd-b200-3505a5a5fada\") " pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.642620 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.642587 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qznq" Jul 12 21:46:07.655514 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:07.655483 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4922907_52ae_46fd_b200_3505a5a5fada.slice/crio-14dd7e3e0b01cd7af7f86a016ae8a45c82edd14917e770608d885547ecdfc970 WatchSource:0}: Error finding container 14dd7e3e0b01cd7af7f86a016ae8a45c82edd14917e770608d885547ecdfc970: Status 404 returned error can't find the container with id 14dd7e3e0b01cd7af7f86a016ae8a45c82edd14917e770608d885547ecdfc970 Jul 12 21:46:07.776094 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.775364 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:46:07.780432 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.780408 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.784716 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.784290 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 12 21:46:07.784716 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.784472 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 12 21:46:07.784716 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.784637 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 12 21:46:07.784716 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.784698 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 12 21:46:07.785044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.784824 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 12 21:46:07.785044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.784883 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 12 21:46:07.785044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.784937 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 12 21:46:07.785044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.785007 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l8spz\"" Jul 12 21:46:07.785221 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.785056 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 12 21:46:07.790211 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.790184 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 12 21:46:07.795408 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.795386 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:46:07.925927 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.925891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-tls-assets\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926181 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.925934 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926181 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.925955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926181 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926181 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-web-config\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926372 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-config-out\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj94h\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-kube-api-access-cj94h\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926773 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-config-volume\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:07.926773 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:07.926522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.027932 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.027837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj94h\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-kube-api-access-cj94h\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.027932 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.027881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-config-volume\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.027932 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.027912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.027944 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-tls-assets\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.027982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028038 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028078 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028130 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-web-config\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028202 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028636 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-config-out\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.028636 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.029061 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.028991 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031281 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031323 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031322 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031446 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031446 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-web-config\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031541 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-config-volume\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031907 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031645 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.031997 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.031951 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.032197 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.032177 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-tls-assets\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.032599 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.032578 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.033470 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.033446 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-config-out\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.036979 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.036934 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj94h\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-kube-api-access-cj94h\") pod \"alertmanager-main-0\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.093367 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.093330 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:46:08.233822 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.233788 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:46:08.236510 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:08.236485 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578f88fb_1ed1_4fb9_a208_4c3342685935.slice/crio-edd9c6dd983f61de977afc2ebed6b9699c689abb796ece59ab62fdb62b5e3b36 WatchSource:0}: Error finding container edd9c6dd983f61de977afc2ebed6b9699c689abb796ece59ab62fdb62b5e3b36: Status 404 returned error can't find the container with id edd9c6dd983f61de977afc2ebed6b9699c689abb796ece59ab62fdb62b5e3b36 Jul 12 21:46:08.538182 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.538151 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerStarted","Data":"edd9c6dd983f61de977afc2ebed6b9699c689abb796ece59ab62fdb62b5e3b36"} Jul 12 21:46:08.539307 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:08.539276 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qznq" event={"ID":"b4922907-52ae-46fd-b200-3505a5a5fada","Type":"ContainerStarted","Data":"14dd7e3e0b01cd7af7f86a016ae8a45c82edd14917e770608d885547ecdfc970"} Jul 12 21:46:09.544573 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.544542 2573 generic.go:356] "Generic (PLEG): container finished" podID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerID="b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631" exitCode=0 Jul 12 21:46:09.545004 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.544629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631"} Jul 12 21:46:09.546288 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.546211 2573 generic.go:356] "Generic (PLEG): container finished" podID="b4922907-52ae-46fd-b200-3505a5a5fada" containerID="ae165f2cd66ed2911f0411f10233437179695093398a767f5147710ff218c0b5" exitCode=0 Jul 12 21:46:09.546354 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.546290 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qznq" event={"ID":"b4922907-52ae-46fd-b200-3505a5a5fada","Type":"ContainerDied","Data":"ae165f2cd66ed2911f0411f10233437179695093398a767f5147710ff218c0b5"} Jul 12 21:46:09.705345 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.705261 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77c495ffb-nrmv4"] Jul 12 21:46:09.709296 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.709275 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.712023 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.711974 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 12 21:46:09.712023 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.711992 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 12 21:46:09.712023 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.712020 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 12 21:46:09.712258 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.711995 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p2tx8\"" Jul 12 21:46:09.712258 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.711973 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 12 21:46:09.712258 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.711999 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 12 21:46:09.712258 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.711996 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-94fi7h9q1ppc6\"" Jul 12 21:46:09.722871 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.722851 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77c495ffb-nrmv4"] Jul 12 21:46:09.842894 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.842861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.842894 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.842897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.843147 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.842916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1be33ef-253f-4e96-8f6d-b01f175d64a1-metrics-client-ca\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.843147 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.843007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.843147 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.843071 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-tls\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.843147 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.843107 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-grpc-tls\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.843147 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.843142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.843321 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.843160 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfnk\" (UniqueName: \"kubernetes.io/projected/b1be33ef-253f-4e96-8f6d-b01f175d64a1-kube-api-access-mgfnk\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944087 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944274 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfnk\" (UniqueName: \"kubernetes.io/projected/b1be33ef-253f-4e96-8f6d-b01f175d64a1-kube-api-access-mgfnk\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944274 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944274 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944274 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1be33ef-253f-4e96-8f6d-b01f175d64a1-metrics-client-ca\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944274 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-tls\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.944584 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.944520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-grpc-tls\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.945307 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.945273 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1be33ef-253f-4e96-8f6d-b01f175d64a1-metrics-client-ca\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.947166 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.947010 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.947499 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.947474 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-tls\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.947586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.947510 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.947723 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.947701 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.947761 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.947745 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-grpc-tls\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.947761 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.947745 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1be33ef-253f-4e96-8f6d-b01f175d64a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:09.952076 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:09.952051 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfnk\" (UniqueName: \"kubernetes.io/projected/b1be33ef-253f-4e96-8f6d-b01f175d64a1-kube-api-access-mgfnk\") pod \"thanos-querier-77c495ffb-nrmv4\" (UID: \"b1be33ef-253f-4e96-8f6d-b01f175d64a1\") " pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:10.018788 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:10.018694 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:10.172118 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:10.172081 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77c495ffb-nrmv4"] Jul 12 21:46:10.175995 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:10.175954 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1be33ef_253f_4e96_8f6d_b01f175d64a1.slice/crio-5b5ebe15577de046c75e70cb669648080fb95ae2ede458d20c85d1cf69fdca2c WatchSource:0}: Error finding container 5b5ebe15577de046c75e70cb669648080fb95ae2ede458d20c85d1cf69fdca2c: Status 404 returned error can't find the container with id 5b5ebe15577de046c75e70cb669648080fb95ae2ede458d20c85d1cf69fdca2c Jul 12 21:46:10.550600 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:10.550567 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" event={"ID":"b1be33ef-253f-4e96-8f6d-b01f175d64a1","Type":"ContainerStarted","Data":"5b5ebe15577de046c75e70cb669648080fb95ae2ede458d20c85d1cf69fdca2c"} Jul 12 21:46:10.552769 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:10.552741 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qznq" event={"ID":"b4922907-52ae-46fd-b200-3505a5a5fada","Type":"ContainerStarted","Data":"5bc6d65fcc8a5b6fd5a8c18fc590016203c9eb565e047ed0be331fc7c2f1b95f"} Jul 12 21:46:10.552921 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:10.552807 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qznq" event={"ID":"b4922907-52ae-46fd-b200-3505a5a5fada","Type":"ContainerStarted","Data":"79f64293f82a2cc817567eeaf450a4a984d156e7eea19bb1cd43cdfd669e825f"} Jul 12 21:46:10.571467 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:10.571413 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4qznq" podStartSLOduration=3.383007107 podStartE2EDuration="4.571392561s" totalImagesPullingTime="1.116913111s" totalInitContainerRuntime="71.472343ms" isStatefulPod=true podCreationTimestamp="2026-07-12 21:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:10.569531751 +0000 UTC m=+110.276988958" watchObservedRunningTime="2026-07-12 21:46:10.571392561 +0000 UTC m=+110.278849726" Jul 12 21:46:11.007866 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.007841 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b9bb57946-fm9ww"] Jul 12 21:46:11.011414 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.011391 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.014686 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.014663 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-srd84\"" Jul 12 21:46:11.014793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.014663 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bh0v9987asfrp\"" Jul 12 21:46:11.014793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.014696 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 12 21:46:11.014793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.014717 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 12 21:46:11.014793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.014718 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 12 21:46:11.015022 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.014663 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 12 21:46:11.020488 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.020464 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b9bb57946-fm9ww"] Jul 12 21:46:11.155459 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.155433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.155544 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.155492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54f404c7-5019-4fd6-98de-bc2db7013921-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.155544 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.155515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/54f404c7-5019-4fd6-98de-bc2db7013921-audit-log\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.155544 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.155538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-secret-metrics-server-tls\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.155698 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.155559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz4wv\" (UniqueName: \"kubernetes.io/projected/54f404c7-5019-4fd6-98de-bc2db7013921-kube-api-access-tz4wv\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.155698 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.155595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/54f404c7-5019-4fd6-98de-bc2db7013921-metrics-server-audit-profiles\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.156311 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.156279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-client-ca-bundle\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.256759 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.256697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-client-ca-bundle\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.256759 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.256750 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.257017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.256808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54f404c7-5019-4fd6-98de-bc2db7013921-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.257017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.256831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/54f404c7-5019-4fd6-98de-bc2db7013921-audit-log\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.257017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.256859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-secret-metrics-server-tls\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.257017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.256900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz4wv\" (UniqueName: \"kubernetes.io/projected/54f404c7-5019-4fd6-98de-bc2db7013921-kube-api-access-tz4wv\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.257017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.256938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/54f404c7-5019-4fd6-98de-bc2db7013921-metrics-server-audit-profiles\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.257346 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.257320 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/54f404c7-5019-4fd6-98de-bc2db7013921-audit-log\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.258658 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.258553 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/54f404c7-5019-4fd6-98de-bc2db7013921-metrics-server-audit-profiles\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.258933 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.258898 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54f404c7-5019-4fd6-98de-bc2db7013921-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.260100 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.260082 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-client-ca-bundle\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.260386 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.260365 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.260632 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.260611 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/54f404c7-5019-4fd6-98de-bc2db7013921-secret-metrics-server-tls\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.266088 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.266061 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz4wv\" (UniqueName: \"kubernetes.io/projected/54f404c7-5019-4fd6-98de-bc2db7013921-kube-api-access-tz4wv\") pod \"metrics-server-5b9bb57946-fm9ww\" (UID: \"54f404c7-5019-4fd6-98de-bc2db7013921\") " pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.344532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.344504 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:11.494557 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.494503 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b9bb57946-fm9ww"] Jul 12 21:46:11.568175 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.568078 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerStarted","Data":"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68"} Jul 12 21:46:11.568594 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.568197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerStarted","Data":"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a"} Jul 12 21:46:11.568594 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.568240 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerStarted","Data":"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9"} Jul 12 21:46:11.568594 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.568279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerStarted","Data":"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2"} Jul 12 21:46:11.568594 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.568323 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerStarted","Data":"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e"} Jul 12 21:46:11.903995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.903946 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln"] Jul 12 21:46:11.907597 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.907572 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.910140 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.910110 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 12 21:46:11.910140 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.910134 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 12 21:46:11.910331 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.910146 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-npdff\"" Jul 12 21:46:11.910331 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.910306 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 12 21:46:11.910634 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.910586 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 12 21:46:11.910727 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.910619 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 12 21:46:11.914281 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.914255 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln"] Jul 12 21:46:11.916243 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.916168 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 12 21:46:11.963059 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963021 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-serving-certs-ca-bundle\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.963254 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963068 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-telemeter-client-tls\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.963254 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.963254 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-secret-telemeter-client\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.963254 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-metrics-client-ca\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.963448 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgmrj\" (UniqueName: \"kubernetes.io/projected/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-kube-api-access-sgmrj\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.963448 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:11.963448 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:11.963385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-federate-client-tls\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.002603 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:12.002571 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f404c7_5019_4fd6_98de_bc2db7013921.slice/crio-af5295dd2405e05ddd81c9b5e1aa9897d7295c92667826493be2da539dddae3a WatchSource:0}: Error finding container af5295dd2405e05ddd81c9b5e1aa9897d7295c92667826493be2da539dddae3a: Status 404 returned error can't find the container with id af5295dd2405e05ddd81c9b5e1aa9897d7295c92667826493be2da539dddae3a Jul 12 21:46:12.063914 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.063888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-federate-client-tls\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064022 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.063940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-serving-certs-ca-bundle\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064022 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.063986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-telemeter-client-tls\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064131 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.064020 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064131 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.064039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-secret-telemeter-client\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064131 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.064058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-metrics-client-ca\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064131 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.064095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgmrj\" (UniqueName: \"kubernetes.io/projected/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-kube-api-access-sgmrj\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064362 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.064144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064788 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.064676 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-serving-certs-ca-bundle\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.064903 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.064857 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.065044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.065021 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-metrics-client-ca\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.067003 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.066983 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.067220 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.067201 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-telemeter-client-tls\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.067259 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.067224 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-federate-client-tls\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.067398 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.067375 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-secret-telemeter-client\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.072385 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.072363 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgmrj\" (UniqueName: \"kubernetes.io/projected/b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0-kube-api-access-sgmrj\") pod \"telemeter-client-78c8b5fcfd-lkmln\" (UID: \"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0\") " pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.220726 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.220629 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" Jul 12 21:46:12.378541 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.378511 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln"] Jul 12 21:46:12.426751 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:12.426676 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4dd3e10_9ac6_484d_80d7_1df8ff51a8d0.slice/crio-88a3ec81247957090e025e5eabab782059a0da140bd7ac2306e44df096b85c9d WatchSource:0}: Error finding container 88a3ec81247957090e025e5eabab782059a0da140bd7ac2306e44df096b85c9d: Status 404 returned error can't find the container with id 88a3ec81247957090e025e5eabab782059a0da140bd7ac2306e44df096b85c9d Jul 12 21:46:12.516226 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.516203 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wcfn9" Jul 12 21:46:12.588827 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.588791 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" event={"ID":"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0","Type":"ContainerStarted","Data":"88a3ec81247957090e025e5eabab782059a0da140bd7ac2306e44df096b85c9d"} Jul 12 21:46:12.589976 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.589922 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" event={"ID":"54f404c7-5019-4fd6-98de-bc2db7013921","Type":"ContainerStarted","Data":"af5295dd2405e05ddd81c9b5e1aa9897d7295c92667826493be2da539dddae3a"} Jul 12 21:46:12.593679 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.593653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerStarted","Data":"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637"} Jul 12 21:46:12.596285 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.596256 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" event={"ID":"b1be33ef-253f-4e96-8f6d-b01f175d64a1","Type":"ContainerStarted","Data":"299ec2ab49eefb5ae020c3d7e8617b570e3d9cbaa13b6a30619e4810223d1573"} Jul 12 21:46:12.596378 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.596328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" event={"ID":"b1be33ef-253f-4e96-8f6d-b01f175d64a1","Type":"ContainerStarted","Data":"d895c7ea82f096e3e611301157bd516718f287deb8163400a52b5526cf65058d"} Jul 12 21:46:12.596378 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.596368 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" event={"ID":"b1be33ef-253f-4e96-8f6d-b01f175d64a1","Type":"ContainerStarted","Data":"2fd52280fec6eae19dce66d7de112a0b7c2eb3d0247a5e2d1053fe0314466444"} Jul 12 21:46:12.628635 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:12.628580 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.863875245 podStartE2EDuration="5.628560943s" totalImagesPullingTime="3.749726871s" totalInitContainerRuntime="14.958827ms" isStatefulPod=false podCreationTimestamp="2026-07-12 21:46:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:12.62708841 +0000 UTC m=+112.334545586" watchObservedRunningTime="2026-07-12 21:46:12.628560943 +0000 UTC m=+112.336018108" Jul 12 21:46:13.381659 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.381489 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:13.381896 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.381853 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:13.388039 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.388013 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:13.605680 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.605194 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" event={"ID":"b1be33ef-253f-4e96-8f6d-b01f175d64a1","Type":"ContainerStarted","Data":"4aa809574056bd84489075e2b5d59249a7b94a2650658197a7da48bbd4a1a6bb"} Jul 12 21:46:13.605680 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.605272 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" event={"ID":"b1be33ef-253f-4e96-8f6d-b01f175d64a1","Type":"ContainerStarted","Data":"541778d6ab33f26a221c7c93ee2dae9e089df314750d9b198f34e28c71dee903"} Jul 12 21:46:13.605680 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.605318 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" event={"ID":"b1be33ef-253f-4e96-8f6d-b01f175d64a1","Type":"ContainerStarted","Data":"cee9fe8415ca216ed7d00364333aa983348a331b44605876e66fe8501928715e"} Jul 12 21:46:13.610923 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.610899 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:13.629440 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:13.629389 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" podStartSLOduration=2.35949124 podStartE2EDuration="4.629367021s" totalImagesPullingTime="2.269875781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:46:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:13.629094373 +0000 UTC m=+113.336551566" watchObservedRunningTime="2026-07-12 21:46:13.629367021 +0000 UTC m=+113.336824185" Jul 12 21:46:14.611770 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:14.611734 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" event={"ID":"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0","Type":"ContainerStarted","Data":"009ed4098a2294d2d15b8c8eb3ad7445a36cd3f3d38ebadc3b95dba22c3e8cb8"} Jul 12 21:46:14.612247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:14.611806 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" event={"ID":"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0","Type":"ContainerStarted","Data":"db3ef568ea576137e32b6f4d6146c1acd7fe6673a10d8d90612443a3481400db"} Jul 12 21:46:14.612247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:14.611829 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" event={"ID":"b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0","Type":"ContainerStarted","Data":"b75edd62f676e364787566c1f8f2cf2ca159fe825b4cdcbb84527f20b459b70b"} Jul 12 21:46:14.613488 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:14.613465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" event={"ID":"54f404c7-5019-4fd6-98de-bc2db7013921","Type":"ContainerStarted","Data":"6494dbed9335275b5cabfcc5ae9f5e2d49a49491894ae027ac09ce8a8e4e5d9c"} Jul 12 21:46:14.613918 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:14.613900 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:14.635905 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:14.635862 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78c8b5fcfd-lkmln" podStartSLOduration=1.875205426 podStartE2EDuration="3.635847296s" totalImagesPullingTime="1.76064187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:14.633407849 +0000 UTC m=+114.340865037" watchObservedRunningTime="2026-07-12 21:46:14.635847296 +0000 UTC m=+114.343304494" Jul 12 21:46:14.653409 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:14.653357 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" podStartSLOduration=2.5117354990000003 podStartE2EDuration="4.653337408s" totalImagesPullingTime="2.141601909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:14.653001454 +0000 UTC m=+114.360458619" watchObservedRunningTime="2026-07-12 21:46:14.653337408 +0000 UTC m=+114.360794573" Jul 12 21:46:16.951859 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:16.951823 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-645d49dcb7-jnbzj"] Jul 12 21:46:16.956435 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:16.956405 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:46:20.624612 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:20.624584 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77c495ffb-nrmv4" Jul 12 21:46:28.076421 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:28.076386 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566645b487-85s5d"] Jul 12 21:46:30.744529 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:30.744494 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:46:30.746801 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:30.746781 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6dd8535-8586-47f0-a162-11f5faae9a5a-metrics-certs\") pod \"network-metrics-daemon-65w8g\" (UID: \"d6dd8535-8586-47f0-a162-11f5faae9a5a\") " pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:46:30.816499 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:30.816467 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8xfd\"" Jul 12 21:46:30.824464 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:30.824437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65w8g" Jul 12 21:46:31.080486 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:31.080456 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-65w8g"] Jul 12 21:46:31.083535 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:46:31.083508 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6dd8535_8586_47f0_a162_11f5faae9a5a.slice/crio-055faac9cc90b42414245e3f8596d04b329648cbd3d397d6a45f85cdd8647df5 WatchSource:0}: Error finding container 055faac9cc90b42414245e3f8596d04b329648cbd3d397d6a45f85cdd8647df5: Status 404 returned error can't find the container with id 055faac9cc90b42414245e3f8596d04b329648cbd3d397d6a45f85cdd8647df5 Jul 12 21:46:31.345403 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:31.345370 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:31.345554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:31.345448 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:31.681944 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:31.681858 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-65w8g" event={"ID":"d6dd8535-8586-47f0-a162-11f5faae9a5a","Type":"ContainerStarted","Data":"055faac9cc90b42414245e3f8596d04b329648cbd3d397d6a45f85cdd8647df5"} Jul 12 21:46:32.688255 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:32.688212 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-65w8g" event={"ID":"d6dd8535-8586-47f0-a162-11f5faae9a5a","Type":"ContainerStarted","Data":"4c502be65dd91beed1b5e5c962e9f1633b65f3ea815692a6d221999efb6f836a"} Jul 12 21:46:32.688708 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:32.688297 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-65w8g" event={"ID":"d6dd8535-8586-47f0-a162-11f5faae9a5a","Type":"ContainerStarted","Data":"a2f8567529b2944e010dd7caa77f50e135d5bcdf117e813d577f1b065bd8be34"} Jul 12 21:46:32.706300 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:32.706252 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-65w8g" podStartSLOduration=130.930512269 podStartE2EDuration="2m11.706237431s" totalImagesPullingTime="775.725162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:46:32.705292763 +0000 UTC m=+132.412749929" watchObservedRunningTime="2026-07-12 21:46:32.706237431 +0000 UTC m=+132.413694622" Jul 12 21:46:33.788848 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:33.788817 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8j7x_0fb8ede1-b2ee-45d7-b127-69f2a42061d9/serve-healthcheck-canary/0.log" Jul 12 21:46:41.976107 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:41.976057 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" podUID="286c5551-aee4-461e-8be9-2b8f65aed5fb" containerName="registry" containerID="cri-o://f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476" gracePeriod=30 Jul 12 21:46:42.222988 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.222951 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:46:42.343495 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343465 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-trusted-ca\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.343654 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343536 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/286c5551-aee4-461e-8be9-2b8f65aed5fb-ca-trust-extracted\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.343654 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343565 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-image-registry-private-configuration\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.343730 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343681 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.343764 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343729 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-certificates\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.343798 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343766 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76554\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-kube-api-access-76554\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.343836 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343810 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-installation-pull-secrets\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.343888 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343838 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-bound-sa-token\") pod \"286c5551-aee4-461e-8be9-2b8f65aed5fb\" (UID: \"286c5551-aee4-461e-8be9-2b8f65aed5fb\") " Jul 12 21:46:42.344024 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.343942 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:46:42.344213 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.344180 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-trusted-ca\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.344328 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.344215 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:46:42.346261 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.346214 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-kube-api-access-76554" (OuterVolumeSpecName: "kube-api-access-76554") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "kube-api-access-76554". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:46:42.346394 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.346368 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:46:42.346476 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.346459 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:46:42.346527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.346470 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:46:42.346609 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.346587 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:46:42.354589 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.354563 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286c5551-aee4-461e-8be9-2b8f65aed5fb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "286c5551-aee4-461e-8be9-2b8f65aed5fb" (UID: "286c5551-aee4-461e-8be9-2b8f65aed5fb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:46:42.445069 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.445018 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/286c5551-aee4-461e-8be9-2b8f65aed5fb-ca-trust-extracted\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.445069 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.445064 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-image-registry-private-configuration\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.445069 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.445075 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-tls\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.445069 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.445084 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/286c5551-aee4-461e-8be9-2b8f65aed5fb-registry-certificates\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.445342 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.445095 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76554\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-kube-api-access-76554\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.445342 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.445116 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/286c5551-aee4-461e-8be9-2b8f65aed5fb-installation-pull-secrets\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.445342 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.445125 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/286c5551-aee4-461e-8be9-2b8f65aed5fb-bound-sa-token\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:42.725734 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.725634 2573 generic.go:356] "Generic (PLEG): container finished" podID="286c5551-aee4-461e-8be9-2b8f65aed5fb" containerID="f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476" exitCode=0 Jul 12 21:46:42.725734 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.725703 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" Jul 12 21:46:42.725734 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.725714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" event={"ID":"286c5551-aee4-461e-8be9-2b8f65aed5fb","Type":"ContainerDied","Data":"f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476"} Jul 12 21:46:42.726044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.725791 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645d49dcb7-jnbzj" event={"ID":"286c5551-aee4-461e-8be9-2b8f65aed5fb","Type":"ContainerDied","Data":"2b4c05f4aa14778698637b2f83d25b63e645cfc41552a2d5200c8ca4a53c10ba"} Jul 12 21:46:42.726044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.725812 2573 scope.go:117] "RemoveContainer" containerID="f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476" Jul 12 21:46:42.735161 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.735144 2573 scope.go:117] "RemoveContainer" containerID="f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476" Jul 12 21:46:42.735421 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:46:42.735401 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476\": container with ID starting with f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476 not found: ID does not exist" containerID="f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476" Jul 12 21:46:42.735468 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.735430 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476"} err="failed to get container status \"f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476\": rpc error: code = NotFound desc = could not find container \"f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476\": container with ID starting with f6c7d6ba982dda992dc7797f4230d361006fb1135944b5246a74a11f9606c476 not found: ID does not exist" Jul 12 21:46:42.747262 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.747234 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-645d49dcb7-jnbzj"] Jul 12 21:46:42.752701 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.752675 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-645d49dcb7-jnbzj"] Jul 12 21:46:42.999603 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:42.999521 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286c5551-aee4-461e-8be9-2b8f65aed5fb" path="/var/lib/kubelet/pods/286c5551-aee4-461e-8be9-2b8f65aed5fb/volumes" Jul 12 21:46:51.350260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:51.350230 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:51.354069 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:51.354048 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b9bb57946-fm9ww" Jul 12 21:46:53.103692 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.103650 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-566645b487-85s5d" podUID="ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" containerName="console" containerID="cri-o://f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d" gracePeriod=15 Jul 12 21:46:53.352552 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.352526 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:53.543110 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543019 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xlph\" (UniqueName: \"kubernetes.io/projected/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-kube-api-access-9xlph\") pod \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " Jul 12 21:46:53.543110 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543064 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-oauth-serving-cert\") pod \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " Jul 12 21:46:53.543110 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543085 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-service-ca\") pod \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " Jul 12 21:46:53.543110 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543111 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-oauth-config\") pod \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " Jul 12 21:46:53.543449 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543162 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-serving-cert\") pod \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " Jul 12 21:46:53.543449 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543195 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-config\") pod \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\" (UID: \"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd\") " Jul 12 21:46:53.543555 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543497 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" (UID: "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:46:53.543555 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543515 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-service-ca" (OuterVolumeSpecName: "service-ca") pod "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" (UID: "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:46:53.543663 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.543586 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-config" (OuterVolumeSpecName: "console-config") pod "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" (UID: "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:46:53.545439 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.545407 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" (UID: "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:46:53.545542 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.545508 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-kube-api-access-9xlph" (OuterVolumeSpecName: "kube-api-access-9xlph") pod "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" (UID: "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd"). InnerVolumeSpecName "kube-api-access-9xlph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:46:53.545542 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.545523 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" (UID: "ddd12a32-9de2-44ee-bb0f-a65a53f95cdd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:46:53.644444 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.644405 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-oauth-config\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:53.644444 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.644436 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-serving-cert\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:53.644444 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.644446 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-console-config\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:53.644664 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.644455 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xlph\" (UniqueName: \"kubernetes.io/projected/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-kube-api-access-9xlph\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:53.644664 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.644464 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-oauth-serving-cert\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:53.644664 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.644473 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd-service-ca\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:46:53.772580 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.772549 2573 generic.go:356] "Generic (PLEG): container finished" podID="ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" containerID="f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d" exitCode=0 Jul 12 21:46:53.772769 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.772593 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566645b487-85s5d" Jul 12 21:46:53.772769 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.772641 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566645b487-85s5d" event={"ID":"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd","Type":"ContainerDied","Data":"f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d"} Jul 12 21:46:53.772769 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.772709 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566645b487-85s5d" event={"ID":"ddd12a32-9de2-44ee-bb0f-a65a53f95cdd","Type":"ContainerDied","Data":"208bcceb24dd6689e39d74cbcd3dec7e72919c4b7d2fad2ac9d4f7118dafe5ad"} Jul 12 21:46:53.772769 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.772738 2573 scope.go:117] "RemoveContainer" containerID="f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d" Jul 12 21:46:53.781511 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.781495 2573 scope.go:117] "RemoveContainer" containerID="f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d" Jul 12 21:46:53.781785 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:46:53.781766 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d\": container with ID starting with f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d not found: ID does not exist" containerID="f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d" Jul 12 21:46:53.781831 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.781793 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d"} err="failed to get container status \"f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d\": rpc error: code = NotFound desc = could not find container \"f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d\": container with ID starting with f2c6be277d0c545af2b6df1658ff875593c7ba795fc5ae12fe1e3621a261af5d not found: ID does not exist" Jul 12 21:46:53.792616 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.792590 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566645b487-85s5d"] Jul 12 21:46:53.796510 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:53.796452 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566645b487-85s5d"] Jul 12 21:46:54.999699 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:46:54.999664 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" path="/var/lib/kubelet/pods/ddd12a32-9de2-44ee-bb0f-a65a53f95cdd/volumes" Jul 12 21:47:24.086685 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.086647 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85744d95cf-pbvpr"] Jul 12 21:47:24.087146 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.086978 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" containerName="console" Jul 12 21:47:24.087146 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.086992 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" containerName="console" Jul 12 21:47:24.087146 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.087007 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286c5551-aee4-461e-8be9-2b8f65aed5fb" containerName="registry" Jul 12 21:47:24.087146 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.087016 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="286c5551-aee4-461e-8be9-2b8f65aed5fb" containerName="registry" Jul 12 21:47:24.087146 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.087111 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="286c5551-aee4-461e-8be9-2b8f65aed5fb" containerName="registry" Jul 12 21:47:24.087146 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.087120 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddd12a32-9de2-44ee-bb0f-a65a53f95cdd" containerName="console" Jul 12 21:47:24.091434 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.091417 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.093855 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.093827 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 12 21:47:24.094039 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.094023 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 12 21:47:24.095476 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.095455 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 12 21:47:24.095615 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.095488 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 12 21:47:24.096005 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.095982 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 12 21:47:24.096107 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.096025 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tdltj\"" Jul 12 21:47:24.096107 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.096041 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 12 21:47:24.096214 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.096106 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 12 21:47:24.099822 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.099802 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 12 21:47:24.102794 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.102765 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85744d95cf-pbvpr"] Jul 12 21:47:24.186516 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.186480 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-trusted-ca-bundle\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.186718 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.186545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-oauth-serving-cert\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.186718 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.186578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-config\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.186718 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.186624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-serving-cert\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.186718 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.186664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-service-ca\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.186718 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.186697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlqp2\" (UniqueName: \"kubernetes.io/projected/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-kube-api-access-jlqp2\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.186907 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.186742 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-oauth-config\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288004 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.287949 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-oauth-config\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288187 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288010 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-trusted-ca-bundle\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288187 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-oauth-serving-cert\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288187 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-config\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288187 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-serving-cert\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288187 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-service-ca\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288187 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlqp2\" (UniqueName: \"kubernetes.io/projected/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-kube-api-access-jlqp2\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.288990 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288937 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-oauth-serving-cert\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.289115 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.288937 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-service-ca\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.289115 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.289032 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-config\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.289115 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.289045 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-trusted-ca-bundle\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.290561 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.290538 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-serving-cert\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.290683 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.290597 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-oauth-config\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.298200 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.298178 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlqp2\" (UniqueName: \"kubernetes.io/projected/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-kube-api-access-jlqp2\") pod \"console-85744d95cf-pbvpr\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.401863 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.401772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:24.532096 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.532023 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85744d95cf-pbvpr"] Jul 12 21:47:24.534673 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:47:24.534637 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcae5b2c_5d70_42ef_8dc0_b94400cb8e7d.slice/crio-3fab534a9254829096a57480f30afdd58faa61108738ed56236927bb0759d7ee WatchSource:0}: Error finding container 3fab534a9254829096a57480f30afdd58faa61108738ed56236927bb0759d7ee: Status 404 returned error can't find the container with id 3fab534a9254829096a57480f30afdd58faa61108738ed56236927bb0759d7ee Jul 12 21:47:24.895823 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.895788 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85744d95cf-pbvpr" event={"ID":"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d","Type":"ContainerStarted","Data":"a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153"} Jul 12 21:47:24.896024 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.895839 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85744d95cf-pbvpr" event={"ID":"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d","Type":"ContainerStarted","Data":"3fab534a9254829096a57480f30afdd58faa61108738ed56236927bb0759d7ee"} Jul 12 21:47:24.915345 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:24.915289 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85744d95cf-pbvpr" podStartSLOduration=0.915272767 podStartE2EDuration="915.272767ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:47:24.914087003 +0000 UTC m=+184.621544167" watchObservedRunningTime="2026-07-12 21:47:24.915272767 +0000 UTC m=+184.622729930" Jul 12 21:47:27.081432 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.081398 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:47:27.081947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.081683 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="alertmanager" containerID="cri-o://3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e" gracePeriod=120 Jul 12 21:47:27.081947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.081763 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-metric" containerID="cri-o://036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68" gracePeriod=120 Jul 12 21:47:27.081947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.081793 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="config-reloader" containerID="cri-o://0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2" gracePeriod=120 Jul 12 21:47:27.081947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.081819 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="prom-label-proxy" containerID="cri-o://6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637" gracePeriod=120 Jul 12 21:47:27.081947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.081801 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy" containerID="cri-o://724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a" gracePeriod=120 Jul 12 21:47:27.081947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.081777 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-web" containerID="cri-o://15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9" gracePeriod=120 Jul 12 21:47:27.912113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912080 2573 generic.go:356] "Generic (PLEG): container finished" podID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerID="6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637" exitCode=0 Jul 12 21:47:27.912113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912103 2573 generic.go:356] "Generic (PLEG): container finished" podID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerID="724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a" exitCode=0 Jul 12 21:47:27.912113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912109 2573 generic.go:356] "Generic (PLEG): container finished" podID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerID="0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2" exitCode=0 Jul 12 21:47:27.912113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912115 2573 generic.go:356] "Generic (PLEG): container finished" podID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerID="3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e" exitCode=0 Jul 12 21:47:27.912387 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912158 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637"} Jul 12 21:47:27.912387 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a"} Jul 12 21:47:27.912387 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912262 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2"} Jul 12 21:47:27.912387 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:27.912292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e"} Jul 12 21:47:28.336281 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.336247 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:28.421122 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421092 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-metrics-client-ca\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421122 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421126 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj94h\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-kube-api-access-cj94h\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421367 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421171 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-web\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421367 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421194 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421367 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421214 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-main-db\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421367 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421231 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-metric\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421367 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421255 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-cluster-tls-config\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421367 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421284 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-tls-assets\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421685 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421527 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:47:28.421739 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421682 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:47:28.421808 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421789 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-main-tls\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421864 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421829 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-web-config\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421916 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421892 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-config-out\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.421987 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.421921 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-config-volume\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.422221 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.422197 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-trusted-ca-bundle\") pod \"578f88fb-1ed1-4fb9-a208-4c3342685935\" (UID: \"578f88fb-1ed1-4fb9-a208-4c3342685935\") " Jul 12 21:47:28.422520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.422497 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-main-db\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.422604 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.422524 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-metrics-client-ca\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.422996 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.422941 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:47:28.423978 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.423914 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:47:28.424461 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.424422 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:47:28.424729 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.424706 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:47:28.425012 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.424983 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-kube-api-access-cj94h" (OuterVolumeSpecName: "kube-api-access-cj94h") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "kube-api-access-cj94h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:47:28.425416 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.425382 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:47:28.425545 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.425514 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-config-out" (OuterVolumeSpecName: "config-out") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:47:28.425957 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.425929 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-config-volume" (OuterVolumeSpecName: "config-volume") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:47:28.425957 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.426011 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:47:28.428983 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.428945 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:47:28.435271 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.435240 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-web-config" (OuterVolumeSpecName: "web-config") pod "578f88fb-1ed1-4fb9-a208-4c3342685935" (UID: "578f88fb-1ed1-4fb9-a208-4c3342685935"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523733 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/578f88fb-1ed1-4fb9-a208-4c3342685935-config-out\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523776 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-config-volume\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523786 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578f88fb-1ed1-4fb9-a208-4c3342685935-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523797 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj94h\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-kube-api-access-cj94h\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523807 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523816 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523826 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523836 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-cluster-tls-config\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.523833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523844 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/578f88fb-1ed1-4fb9-a208-4c3342685935-tls-assets\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.524251 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523879 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-secret-alertmanager-main-tls\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.524251 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.523891 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/578f88fb-1ed1-4fb9-a208-4c3342685935-web-config\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:47:28.919889 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.919855 2573 generic.go:356] "Generic (PLEG): container finished" podID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerID="036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68" exitCode=0 Jul 12 21:47:28.919889 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.919881 2573 generic.go:356] "Generic (PLEG): container finished" podID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerID="15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9" exitCode=0 Jul 12 21:47:28.920111 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.919938 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:28.920111 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.919942 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68"} Jul 12 21:47:28.920111 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.920050 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9"} Jul 12 21:47:28.920111 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.920096 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"578f88fb-1ed1-4fb9-a208-4c3342685935","Type":"ContainerDied","Data":"edd9c6dd983f61de977afc2ebed6b9699c689abb796ece59ab62fdb62b5e3b36"} Jul 12 21:47:28.920111 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.920111 2573 scope.go:117] "RemoveContainer" containerID="6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637" Jul 12 21:47:28.932844 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.932823 2573 scope.go:117] "RemoveContainer" containerID="036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68" Jul 12 21:47:28.940508 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.940486 2573 scope.go:117] "RemoveContainer" containerID="724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a" Jul 12 21:47:28.946674 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.946643 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:47:28.947991 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.947952 2573 scope.go:117] "RemoveContainer" containerID="15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9" Jul 12 21:47:28.950608 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.950590 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:47:28.955565 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.955549 2573 scope.go:117] "RemoveContainer" containerID="0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2" Jul 12 21:47:28.962346 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.962326 2573 scope.go:117] "RemoveContainer" containerID="3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e" Jul 12 21:47:28.969279 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.969262 2573 scope.go:117] "RemoveContainer" containerID="b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631" Jul 12 21:47:28.976245 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.976226 2573 scope.go:117] "RemoveContainer" containerID="6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637" Jul 12 21:47:28.976511 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:47:28.976488 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637\": container with ID starting with 6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637 not found: ID does not exist" containerID="6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637" Jul 12 21:47:28.976596 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.976517 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637"} err="failed to get container status \"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637\": rpc error: code = NotFound desc = could not find container \"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637\": container with ID starting with 6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637 not found: ID does not exist" Jul 12 21:47:28.976596 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.976534 2573 scope.go:117] "RemoveContainer" containerID="036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68" Jul 12 21:47:28.976772 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:47:28.976757 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68\": container with ID starting with 036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68 not found: ID does not exist" containerID="036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68" Jul 12 21:47:28.976812 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.976776 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68"} err="failed to get container status \"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68\": rpc error: code = NotFound desc = could not find container \"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68\": container with ID starting with 036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68 not found: ID does not exist" Jul 12 21:47:28.976812 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.976789 2573 scope.go:117] "RemoveContainer" containerID="724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a" Jul 12 21:47:28.977040 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:47:28.977020 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a\": container with ID starting with 724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a not found: ID does not exist" containerID="724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a" Jul 12 21:47:28.977125 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.977043 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a"} err="failed to get container status \"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a\": rpc error: code = NotFound desc = could not find container \"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a\": container with ID starting with 724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a not found: ID does not exist" Jul 12 21:47:28.977125 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.977063 2573 scope.go:117] "RemoveContainer" containerID="15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9" Jul 12 21:47:28.977349 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:47:28.977326 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9\": container with ID starting with 15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9 not found: ID does not exist" containerID="15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9" Jul 12 21:47:28.977436 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.977350 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9"} err="failed to get container status \"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9\": rpc error: code = NotFound desc = could not find container \"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9\": container with ID starting with 15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9 not found: ID does not exist" Jul 12 21:47:28.977436 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.977369 2573 scope.go:117] "RemoveContainer" containerID="0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2" Jul 12 21:47:28.977720 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:47:28.977696 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2\": container with ID starting with 0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2 not found: ID does not exist" containerID="0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2" Jul 12 21:47:28.977808 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.977724 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2"} err="failed to get container status \"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2\": rpc error: code = NotFound desc = could not find container \"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2\": container with ID starting with 0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2 not found: ID does not exist" Jul 12 21:47:28.977808 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.977743 2573 scope.go:117] "RemoveContainer" containerID="3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e" Jul 12 21:47:28.978056 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:47:28.978035 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e\": container with ID starting with 3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e not found: ID does not exist" containerID="3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e" Jul 12 21:47:28.978258 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978079 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e"} err="failed to get container status \"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e\": rpc error: code = NotFound desc = could not find container \"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e\": container with ID starting with 3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e not found: ID does not exist" Jul 12 21:47:28.978258 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978098 2573 scope.go:117] "RemoveContainer" containerID="b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631" Jul 12 21:47:28.978417 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:47:28.978399 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631\": container with ID starting with b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631 not found: ID does not exist" containerID="b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631" Jul 12 21:47:28.978482 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978424 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631"} err="failed to get container status \"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631\": rpc error: code = NotFound desc = could not find container \"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631\": container with ID starting with b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631 not found: ID does not exist" Jul 12 21:47:28.978482 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978446 2573 scope.go:117] "RemoveContainer" containerID="6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637" Jul 12 21:47:28.978708 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978687 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637"} err="failed to get container status \"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637\": rpc error: code = NotFound desc = could not find container \"6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637\": container with ID starting with 6e4929d6735b79842a409937005bb4f7c5bbc2ae0014acf15a0f557d50519637 not found: ID does not exist" Jul 12 21:47:28.978753 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978714 2573 scope.go:117] "RemoveContainer" containerID="036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68" Jul 12 21:47:28.978947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978930 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68"} err="failed to get container status \"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68\": rpc error: code = NotFound desc = could not find container \"036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68\": container with ID starting with 036dab5a0ee5f8a47971e5cc489882699321fe6af6bce2e969ed3faf165a6b68 not found: ID does not exist" Jul 12 21:47:28.979113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.978950 2573 scope.go:117] "RemoveContainer" containerID="724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a" Jul 12 21:47:28.979222 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979205 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:47:28.979260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979216 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a"} err="failed to get container status \"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a\": rpc error: code = NotFound desc = could not find container \"724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a\": container with ID starting with 724818a62b7c457d854b3f1c5afb02232b27255fff90b497d45e2685072cae6a not found: ID does not exist" Jul 12 21:47:28.979260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979232 2573 scope.go:117] "RemoveContainer" containerID="15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9" Jul 12 21:47:28.979472 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979454 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9"} err="failed to get container status \"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9\": rpc error: code = NotFound desc = could not find container \"15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9\": container with ID starting with 15ec7826d365cf05a6823f7ad08de5dd4baf860bb16603d7ea0dee13cd5da0e9 not found: ID does not exist" Jul 12 21:47:28.979548 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979472 2573 scope.go:117] "RemoveContainer" containerID="0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2" Jul 12 21:47:28.979548 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979533 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-metric" Jul 12 21:47:28.979548 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979545 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-metric" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979554 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="init-config-reloader" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979560 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="init-config-reloader" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979571 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="alertmanager" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979578 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="alertmanager" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979592 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="config-reloader" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979600 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="config-reloader" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979613 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-web" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979619 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-web" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979625 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="prom-label-proxy" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979631 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="prom-label-proxy" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979637 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy" Jul 12 21:47:28.979677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979642 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979696 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979695 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2"} err="failed to get container status \"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2\": rpc error: code = NotFound desc = could not find container \"0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2\": container with ID starting with 0c07041a10c47741f0a13a5046414267aaf91564238af4bbb5cff6301420c1b2 not found: ID does not exist" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979712 2573 scope.go:117] "RemoveContainer" containerID="3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979705 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="alertmanager" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979782 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-web" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979792 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="prom-label-proxy" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979798 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="kube-rbac-proxy-metric" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979808 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" containerName="config-reloader" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979926 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e"} err="failed to get container status \"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e\": rpc error: code = NotFound desc = could not find container \"3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e\": container with ID starting with 3f7752688e2fd3af68025d609c769e3271fd2416e75959f2873505cf5d9da02e not found: ID does not exist" Jul 12 21:47:28.980113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.979952 2573 scope.go:117] "RemoveContainer" containerID="b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631" Jul 12 21:47:28.980427 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.980251 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631"} err="failed to get container status \"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631\": rpc error: code = NotFound desc = could not find container \"b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631\": container with ID starting with b919d4a1f317baacf026150bd5b50134c9ab248e79b9232b4d2d4d5ad12b3631 not found: ID does not exist" Jul 12 21:47:28.984986 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.984948 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:28.987406 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.987385 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 12 21:47:28.987533 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.987425 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 12 21:47:28.987533 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.987442 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 12 21:47:28.987687 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.987673 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 12 21:47:28.987771 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.987752 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 12 21:47:28.987916 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.987901 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 12 21:47:28.987972 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.987922 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 12 21:47:28.988234 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.988220 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 12 21:47:28.988309 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.988245 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l8spz\"" Jul 12 21:47:28.993268 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.993248 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 12 21:47:28.999630 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:28.999571 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="578f88fb-1ed1-4fb9-a208-4c3342685935" path="/var/lib/kubelet/pods/578f88fb-1ed1-4fb9-a208-4c3342685935/volumes" Jul 12 21:47:29.003508 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.003487 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:47:29.129930 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.129893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-web-config\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.129930 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.129932 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130153 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130153 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130132 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130239 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130157 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130239 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130239 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130222 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130345 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130403 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130446 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130481 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbhg2\" (UniqueName: \"kubernetes.io/projected/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-kube-api-access-lbhg2\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130521 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.130640 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.130621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-config-out\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231291 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231291 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231464 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231464 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231405 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231464 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231589 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231471 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbhg2\" (UniqueName: \"kubernetes.io/projected/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-kube-api-access-lbhg2\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231589 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231498 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231589 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231530 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-config-out\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231689 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-web-config\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231689 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231610 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231689 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231622 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231689 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231869 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.231869 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.231724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.233014 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.232628 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.234553 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.234527 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.234716 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.234527 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.234897 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.234871 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.234897 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.234889 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-web-config\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.235059 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.234935 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.235122 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.235093 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-config-out\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.235342 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.235324 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.235508 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.235492 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.235643 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.235622 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.236453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.236435 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.239260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.239237 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbhg2\" (UniqueName: \"kubernetes.io/projected/c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3-kube-api-access-lbhg2\") pod \"alertmanager-main-0\" (UID: \"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.295974 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.295936 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 21:47:29.434063 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.434030 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 21:47:29.437210 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:47:29.437179 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7904be8_9a46_4a27_96bb_5cf2ee4fbbc3.slice/crio-44c6ad37c6d2b8f470198db04a4807fc27b06e658c37b36e5c01e36e05301068 WatchSource:0}: Error finding container 44c6ad37c6d2b8f470198db04a4807fc27b06e658c37b36e5c01e36e05301068: Status 404 returned error can't find the container with id 44c6ad37c6d2b8f470198db04a4807fc27b06e658c37b36e5c01e36e05301068 Jul 12 21:47:29.925715 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.925681 2573 generic.go:356] "Generic (PLEG): container finished" podID="c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3" containerID="11fee440fcd88581470b0587e0c083faa241d296bed6c6cd311e6923e02e24c7" exitCode=0 Jul 12 21:47:29.925919 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.925770 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerDied","Data":"11fee440fcd88581470b0587e0c083faa241d296bed6c6cd311e6923e02e24c7"} Jul 12 21:47:29.925919 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:29.925842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerStarted","Data":"44c6ad37c6d2b8f470198db04a4807fc27b06e658c37b36e5c01e36e05301068"} Jul 12 21:47:30.934537 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:30.934503 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerStarted","Data":"7d622b95f379631b45e25c26202f13e09e87b41a6c236d5ec608701aaeaa48d5"} Jul 12 21:47:30.935017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:30.934615 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerStarted","Data":"9b937966bdbc5ae635e9b8cd7dc5601a8d3ef64a1b84c87219d39db9517b7460"} Jul 12 21:47:30.935017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:30.934663 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerStarted","Data":"0ee2ec3ecaa19526a2cb3323c4ab0d93d5dffdd7081ff049ca61a2a6e4aba6a6"} Jul 12 21:47:30.935017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:30.934706 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerStarted","Data":"81a9e3c9d60f0e44d3d67c1b91403d3d85f2856a897bfe732ab8c973889f17a5"} Jul 12 21:47:30.935017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:30.934744 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerStarted","Data":"12b1c81ea0605bdb468ba0a78953edbee0379e8b4f04591ced888b31722f821c"} Jul 12 21:47:30.935017 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:30.934781 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3","Type":"ContainerStarted","Data":"2f5b785032324f1e7f9295703875fd6adbebf40d834746488cd1c37c754f469e"} Jul 12 21:47:30.985212 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:30.985152 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.970770529 podStartE2EDuration="2.98512982s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.359291ms" isStatefulPod=false podCreationTimestamp="2026-07-12 21:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:47:30.984004354 +0000 UTC m=+190.691461519" watchObservedRunningTime="2026-07-12 21:47:30.98512982 +0000 UTC m=+190.692586986" Jul 12 21:47:34.402440 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:34.402389 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:34.402922 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:34.402469 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:34.407456 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:34.407430 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:47:34.954338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:47:34.954310 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:48:39.576413 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.576376 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7"] Jul 12 21:48:39.581518 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.581495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.584024 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.584002 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 21:48:39.584777 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.584762 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 21:48:39.584828 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.584768 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dv6hl\"" Jul 12 21:48:39.590944 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.590922 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7"] Jul 12 21:48:39.711185 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.711146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.711185 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.711186 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpvd\" (UniqueName: \"kubernetes.io/projected/d87e250e-0c1e-4746-b011-b249fe00d09d-kube-api-access-4fpvd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.711400 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.711253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.812338 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.812301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.812477 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.812344 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpvd\" (UniqueName: \"kubernetes.io/projected/d87e250e-0c1e-4746-b011-b249fe00d09d-kube-api-access-4fpvd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.812477 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.812405 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.812732 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.812714 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.812824 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.812807 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.822209 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.822180 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpvd\" (UniqueName: \"kubernetes.io/projected/d87e250e-0c1e-4746-b011-b249fe00d09d-kube-api-access-4fpvd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:39.890851 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:39.890814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:40.017927 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:40.017893 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7"] Jul 12 21:48:40.020930 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:48:40.020899 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87e250e_0c1e_4746_b011_b249fe00d09d.slice/crio-4e17385b77262dad7211d2d248e36054ae0db9ea50525dbbacb427030e68d790 WatchSource:0}: Error finding container 4e17385b77262dad7211d2d248e36054ae0db9ea50525dbbacb427030e68d790: Status 404 returned error can't find the container with id 4e17385b77262dad7211d2d248e36054ae0db9ea50525dbbacb427030e68d790 Jul 12 21:48:40.205397 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:40.205305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" event={"ID":"d87e250e-0c1e-4746-b011-b249fe00d09d","Type":"ContainerStarted","Data":"4e17385b77262dad7211d2d248e36054ae0db9ea50525dbbacb427030e68d790"} Jul 12 21:48:46.233219 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:46.233181 2573 generic.go:356] "Generic (PLEG): container finished" podID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerID="1f097eb7fea5d3f2d0f1a48b12dff07268ce2a5c83e2486991e2b3c8e3ae2e49" exitCode=0 Jul 12 21:48:46.233219 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:46.233221 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" event={"ID":"d87e250e-0c1e-4746-b011-b249fe00d09d","Type":"ContainerDied","Data":"1f097eb7fea5d3f2d0f1a48b12dff07268ce2a5c83e2486991e2b3c8e3ae2e49"} Jul 12 21:48:49.246767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:49.246735 2573 generic.go:356] "Generic (PLEG): container finished" podID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerID="4fafd14cbfda385d4a0c8ba509ab2487418e76692adda306455b52c288e0022c" exitCode=0 Jul 12 21:48:49.247176 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:49.246807 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" event={"ID":"d87e250e-0c1e-4746-b011-b249fe00d09d","Type":"ContainerDied","Data":"4fafd14cbfda385d4a0c8ba509ab2487418e76692adda306455b52c288e0022c"} Jul 12 21:48:56.280608 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:56.280573 2573 generic.go:356] "Generic (PLEG): container finished" podID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerID="3fccdde2da21d7247e03cfd446f6d0c8013cb879e0b17d5e72dc371caddea568" exitCode=0 Jul 12 21:48:56.281099 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:56.280639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" event={"ID":"d87e250e-0c1e-4746-b011-b249fe00d09d","Type":"ContainerDied","Data":"3fccdde2da21d7247e03cfd446f6d0c8013cb879e0b17d5e72dc371caddea568"} Jul 12 21:48:57.419390 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.419365 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:57.477242 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.477206 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fpvd\" (UniqueName: \"kubernetes.io/projected/d87e250e-0c1e-4746-b011-b249fe00d09d-kube-api-access-4fpvd\") pod \"d87e250e-0c1e-4746-b011-b249fe00d09d\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " Jul 12 21:48:57.477437 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.477258 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-bundle\") pod \"d87e250e-0c1e-4746-b011-b249fe00d09d\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " Jul 12 21:48:57.477437 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.477289 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-util\") pod \"d87e250e-0c1e-4746-b011-b249fe00d09d\" (UID: \"d87e250e-0c1e-4746-b011-b249fe00d09d\") " Jul 12 21:48:57.477985 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.477936 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-bundle" (OuterVolumeSpecName: "bundle") pod "d87e250e-0c1e-4746-b011-b249fe00d09d" (UID: "d87e250e-0c1e-4746-b011-b249fe00d09d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:48:57.479464 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.479432 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87e250e-0c1e-4746-b011-b249fe00d09d-kube-api-access-4fpvd" (OuterVolumeSpecName: "kube-api-access-4fpvd") pod "d87e250e-0c1e-4746-b011-b249fe00d09d" (UID: "d87e250e-0c1e-4746-b011-b249fe00d09d"). InnerVolumeSpecName "kube-api-access-4fpvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:48:57.481954 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.481931 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-util" (OuterVolumeSpecName: "util") pod "d87e250e-0c1e-4746-b011-b249fe00d09d" (UID: "d87e250e-0c1e-4746-b011-b249fe00d09d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:48:57.578792 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.578706 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fpvd\" (UniqueName: \"kubernetes.io/projected/d87e250e-0c1e-4746-b011-b249fe00d09d-kube-api-access-4fpvd\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:48:57.578792 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.578733 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:48:57.578792 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:57.578741 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87e250e-0c1e-4746-b011-b249fe00d09d-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:48:58.290113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:58.290083 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" Jul 12 21:48:58.290113 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:58.290101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jrbh7" event={"ID":"d87e250e-0c1e-4746-b011-b249fe00d09d","Type":"ContainerDied","Data":"4e17385b77262dad7211d2d248e36054ae0db9ea50525dbbacb427030e68d790"} Jul 12 21:48:58.290332 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:48:58.290157 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e17385b77262dad7211d2d248e36054ae0db9ea50525dbbacb427030e68d790" Jul 12 21:49:02.504353 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504315 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd"] Jul 12 21:49:02.504754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504633 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerName="extract" Jul 12 21:49:02.504754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504643 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerName="extract" Jul 12 21:49:02.504754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504651 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerName="util" Jul 12 21:49:02.504754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504657 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerName="util" Jul 12 21:49:02.504754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504667 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerName="pull" Jul 12 21:49:02.504754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504672 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerName="pull" Jul 12 21:49:02.504754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.504726 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87e250e-0c1e-4746-b011-b249fe00d09d" containerName="extract" Jul 12 21:49:02.508666 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.508647 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.511412 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.511383 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5kcpc\"" Jul 12 21:49:02.511529 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.511415 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 12 21:49:02.511529 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.511482 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 12 21:49:02.520011 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.519989 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd"] Jul 12 21:49:02.615196 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.615157 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkcpt\" (UniqueName: \"kubernetes.io/projected/f0220885-3eca-4e2a-aa29-dc320e98f339-kube-api-access-tkcpt\") pod \"cert-manager-operator-controller-manager-55c444bf86-tltdd\" (UID: \"f0220885-3eca-4e2a-aa29-dc320e98f339\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.615196 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.615199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0220885-3eca-4e2a-aa29-dc320e98f339-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tltdd\" (UID: \"f0220885-3eca-4e2a-aa29-dc320e98f339\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.715861 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.715824 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkcpt\" (UniqueName: \"kubernetes.io/projected/f0220885-3eca-4e2a-aa29-dc320e98f339-kube-api-access-tkcpt\") pod \"cert-manager-operator-controller-manager-55c444bf86-tltdd\" (UID: \"f0220885-3eca-4e2a-aa29-dc320e98f339\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.716071 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.715869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0220885-3eca-4e2a-aa29-dc320e98f339-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tltdd\" (UID: \"f0220885-3eca-4e2a-aa29-dc320e98f339\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.716353 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.716330 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0220885-3eca-4e2a-aa29-dc320e98f339-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tltdd\" (UID: \"f0220885-3eca-4e2a-aa29-dc320e98f339\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.724112 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.724087 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkcpt\" (UniqueName: \"kubernetes.io/projected/f0220885-3eca-4e2a-aa29-dc320e98f339-kube-api-access-tkcpt\") pod \"cert-manager-operator-controller-manager-55c444bf86-tltdd\" (UID: \"f0220885-3eca-4e2a-aa29-dc320e98f339\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.817982 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.817872 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" Jul 12 21:49:02.954270 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:02.954231 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd"] Jul 12 21:49:02.957387 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:49:02.957359 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0220885_3eca_4e2a_aa29_dc320e98f339.slice/crio-bf8724bb85d2e6b0b9b2f25cb9b4bca190e4759f590f27b06203b37465ad28dc WatchSource:0}: Error finding container bf8724bb85d2e6b0b9b2f25cb9b4bca190e4759f590f27b06203b37465ad28dc: Status 404 returned error can't find the container with id bf8724bb85d2e6b0b9b2f25cb9b4bca190e4759f590f27b06203b37465ad28dc Jul 12 21:49:03.310654 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:03.310618 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" event={"ID":"f0220885-3eca-4e2a-aa29-dc320e98f339","Type":"ContainerStarted","Data":"bf8724bb85d2e6b0b9b2f25cb9b4bca190e4759f590f27b06203b37465ad28dc"} Jul 12 21:49:05.320606 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:05.320574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" event={"ID":"f0220885-3eca-4e2a-aa29-dc320e98f339","Type":"ContainerStarted","Data":"565b99364478e027184662b9c60977d5513f1538a392319bd2753e059433487a"} Jul 12 21:49:05.349436 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:05.345364 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tltdd" podStartSLOduration=1.713312153 podStartE2EDuration="3.345343862s" totalImagesPullingTime="1.632031709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:49:05.342634642 +0000 UTC m=+285.050091810" watchObservedRunningTime="2026-07-12 21:49:05.345343862 +0000 UTC m=+285.052801030" Jul 12 21:49:06.511981 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.511932 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc"] Jul 12 21:49:06.515576 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.515558 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.518612 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.518594 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 21:49:06.519410 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.519395 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 21:49:06.520443 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.520423 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dv6hl\"" Jul 12 21:49:06.550651 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.550623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpwx\" (UniqueName: \"kubernetes.io/projected/c218680b-5d04-4998-b107-03fd3ddc2256-kube-api-access-kkpwx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.550856 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.550666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.550856 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.550747 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.562865 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.562834 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc"] Jul 12 21:49:06.651589 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.651552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.651769 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.651619 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.651769 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.651663 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpwx\" (UniqueName: \"kubernetes.io/projected/c218680b-5d04-4998-b107-03fd3ddc2256-kube-api-access-kkpwx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.652010 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.651949 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.652010 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.651999 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.671823 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.671792 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpwx\" (UniqueName: \"kubernetes.io/projected/c218680b-5d04-4998-b107-03fd3ddc2256-kube-api-access-kkpwx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.825836 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.825748 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:06.958251 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:06.958222 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc"] Jul 12 21:49:06.960248 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:49:06.960220 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc218680b_5d04_4998_b107_03fd3ddc2256.slice/crio-89bbbd74da74cacdbab38a942c685ce584d6cfbd4397287236973d701343636e WatchSource:0}: Error finding container 89bbbd74da74cacdbab38a942c685ce584d6cfbd4397287236973d701343636e: Status 404 returned error can't find the container with id 89bbbd74da74cacdbab38a942c685ce584d6cfbd4397287236973d701343636e Jul 12 21:49:07.330945 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:07.330908 2573 generic.go:356] "Generic (PLEG): container finished" podID="c218680b-5d04-4998-b107-03fd3ddc2256" containerID="99672202db5c0b4f6f85cdaa4f21987dacd354b5f15946bbaf9000af1ad95609" exitCode=0 Jul 12 21:49:07.331150 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:07.330991 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" event={"ID":"c218680b-5d04-4998-b107-03fd3ddc2256","Type":"ContainerDied","Data":"99672202db5c0b4f6f85cdaa4f21987dacd354b5f15946bbaf9000af1ad95609"} Jul 12 21:49:07.331150 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:07.331045 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" event={"ID":"c218680b-5d04-4998-b107-03fd3ddc2256","Type":"ContainerStarted","Data":"89bbbd74da74cacdbab38a942c685ce584d6cfbd4397287236973d701343636e"} Jul 12 21:49:09.410721 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.410698 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf"] Jul 12 21:49:09.420166 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.420141 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.423721 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.423644 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf"] Jul 12 21:49:09.423793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.423732 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 12 21:49:09.424626 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.424608 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 12 21:49:09.424756 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.424608 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5sxqv\"" Jul 12 21:49:09.479622 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.479590 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4qw\" (UniqueName: \"kubernetes.io/projected/1739357f-b8af-488c-a0f0-0e767e53ea90-kube-api-access-ww4qw\") pod \"cert-manager-cainjector-559cdd8c87-vcxxf\" (UID: \"1739357f-b8af-488c-a0f0-0e767e53ea90\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.479780 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.479659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1739357f-b8af-488c-a0f0-0e767e53ea90-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vcxxf\" (UID: \"1739357f-b8af-488c-a0f0-0e767e53ea90\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.581112 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.581074 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4qw\" (UniqueName: \"kubernetes.io/projected/1739357f-b8af-488c-a0f0-0e767e53ea90-kube-api-access-ww4qw\") pod \"cert-manager-cainjector-559cdd8c87-vcxxf\" (UID: \"1739357f-b8af-488c-a0f0-0e767e53ea90\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.581341 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.581142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1739357f-b8af-488c-a0f0-0e767e53ea90-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vcxxf\" (UID: \"1739357f-b8af-488c-a0f0-0e767e53ea90\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.589906 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.589872 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1739357f-b8af-488c-a0f0-0e767e53ea90-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vcxxf\" (UID: \"1739357f-b8af-488c-a0f0-0e767e53ea90\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.590041 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.589946 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4qw\" (UniqueName: \"kubernetes.io/projected/1739357f-b8af-488c-a0f0-0e767e53ea90-kube-api-access-ww4qw\") pod \"cert-manager-cainjector-559cdd8c87-vcxxf\" (UID: \"1739357f-b8af-488c-a0f0-0e767e53ea90\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.730297 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.730211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" Jul 12 21:49:09.857680 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:09.857654 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf"] Jul 12 21:49:09.860122 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:49:09.860094 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1739357f_b8af_488c_a0f0_0e767e53ea90.slice/crio-bc19714ac35b78a4b0dc7fa9dc9af7b82d4c2c23a413e57e1de6709e288cc36c WatchSource:0}: Error finding container bc19714ac35b78a4b0dc7fa9dc9af7b82d4c2c23a413e57e1de6709e288cc36c: Status 404 returned error can't find the container with id bc19714ac35b78a4b0dc7fa9dc9af7b82d4c2c23a413e57e1de6709e288cc36c Jul 12 21:49:10.345699 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.345656 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" event={"ID":"1739357f-b8af-488c-a0f0-0e767e53ea90","Type":"ContainerStarted","Data":"bc19714ac35b78a4b0dc7fa9dc9af7b82d4c2c23a413e57e1de6709e288cc36c"} Jul 12 21:49:10.347422 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.347389 2573 generic.go:356] "Generic (PLEG): container finished" podID="c218680b-5d04-4998-b107-03fd3ddc2256" containerID="456b71c5012ae4319481867e536354a40ca87410b6ca406f8226f1ed281d7d3b" exitCode=0 Jul 12 21:49:10.347533 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.347447 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" event={"ID":"c218680b-5d04-4998-b107-03fd3ddc2256","Type":"ContainerDied","Data":"456b71c5012ae4319481867e536354a40ca87410b6ca406f8226f1ed281d7d3b"} Jul 12 21:49:10.770074 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.769993 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p6nlg"] Jul 12 21:49:10.773546 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.773522 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:10.776159 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.776135 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6swkm\"" Jul 12 21:49:10.784565 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.784527 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p6nlg"] Jul 12 21:49:10.893315 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.893278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7d1035e-e76b-471a-8376-79b4512fd919-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p6nlg\" (UID: \"f7d1035e-e76b-471a-8376-79b4512fd919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:10.893507 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.893377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcm8t\" (UniqueName: \"kubernetes.io/projected/f7d1035e-e76b-471a-8376-79b4512fd919-kube-api-access-dcm8t\") pod \"cert-manager-webhook-6486ffd997-p6nlg\" (UID: \"f7d1035e-e76b-471a-8376-79b4512fd919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:10.993899 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.993860 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7d1035e-e76b-471a-8376-79b4512fd919-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p6nlg\" (UID: \"f7d1035e-e76b-471a-8376-79b4512fd919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:10.994109 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:10.993937 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcm8t\" (UniqueName: \"kubernetes.io/projected/f7d1035e-e76b-471a-8376-79b4512fd919-kube-api-access-dcm8t\") pod \"cert-manager-webhook-6486ffd997-p6nlg\" (UID: \"f7d1035e-e76b-471a-8376-79b4512fd919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:11.003803 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:11.003774 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7d1035e-e76b-471a-8376-79b4512fd919-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p6nlg\" (UID: \"f7d1035e-e76b-471a-8376-79b4512fd919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:11.003995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:11.003872 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcm8t\" (UniqueName: \"kubernetes.io/projected/f7d1035e-e76b-471a-8376-79b4512fd919-kube-api-access-dcm8t\") pod \"cert-manager-webhook-6486ffd997-p6nlg\" (UID: \"f7d1035e-e76b-471a-8376-79b4512fd919\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:11.085173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:11.085136 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:11.238812 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:11.238784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p6nlg"] Jul 12 21:49:11.245426 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:49:11.245386 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7d1035e_e76b_471a_8376_79b4512fd919.slice/crio-fdef04a30385e5ee30413d7527538aceea5be551ac6ee15f4337fb50ab4a8387 WatchSource:0}: Error finding container fdef04a30385e5ee30413d7527538aceea5be551ac6ee15f4337fb50ab4a8387: Status 404 returned error can't find the container with id fdef04a30385e5ee30413d7527538aceea5be551ac6ee15f4337fb50ab4a8387 Jul 12 21:49:11.356892 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:11.356804 2573 generic.go:356] "Generic (PLEG): container finished" podID="c218680b-5d04-4998-b107-03fd3ddc2256" containerID="ce2dcb08f9436ce5365d604c1cda3b6dbce2dd55140b8bedd840244c668d82ab" exitCode=0 Jul 12 21:49:11.356892 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:11.356883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" event={"ID":"c218680b-5d04-4998-b107-03fd3ddc2256","Type":"ContainerDied","Data":"ce2dcb08f9436ce5365d604c1cda3b6dbce2dd55140b8bedd840244c668d82ab"} Jul 12 21:49:11.358116 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:11.358092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" event={"ID":"f7d1035e-e76b-471a-8376-79b4512fd919","Type":"ContainerStarted","Data":"fdef04a30385e5ee30413d7527538aceea5be551ac6ee15f4337fb50ab4a8387"} Jul 12 21:49:12.511870 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.511844 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:12.608569 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.608538 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-util\") pod \"c218680b-5d04-4998-b107-03fd3ddc2256\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " Jul 12 21:49:12.608746 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.608646 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkpwx\" (UniqueName: \"kubernetes.io/projected/c218680b-5d04-4998-b107-03fd3ddc2256-kube-api-access-kkpwx\") pod \"c218680b-5d04-4998-b107-03fd3ddc2256\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " Jul 12 21:49:12.608746 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.608698 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-bundle\") pod \"c218680b-5d04-4998-b107-03fd3ddc2256\" (UID: \"c218680b-5d04-4998-b107-03fd3ddc2256\") " Jul 12 21:49:12.609169 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.609138 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-bundle" (OuterVolumeSpecName: "bundle") pod "c218680b-5d04-4998-b107-03fd3ddc2256" (UID: "c218680b-5d04-4998-b107-03fd3ddc2256"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:49:12.610803 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.610780 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c218680b-5d04-4998-b107-03fd3ddc2256-kube-api-access-kkpwx" (OuterVolumeSpecName: "kube-api-access-kkpwx") pod "c218680b-5d04-4998-b107-03fd3ddc2256" (UID: "c218680b-5d04-4998-b107-03fd3ddc2256"). InnerVolumeSpecName "kube-api-access-kkpwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:49:12.612804 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.612749 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-util" (OuterVolumeSpecName: "util") pod "c218680b-5d04-4998-b107-03fd3ddc2256" (UID: "c218680b-5d04-4998-b107-03fd3ddc2256"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:49:12.709808 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.709771 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkpwx\" (UniqueName: \"kubernetes.io/projected/c218680b-5d04-4998-b107-03fd3ddc2256-kube-api-access-kkpwx\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:49:12.709808 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.709802 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:49:12.709808 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:12.709811 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c218680b-5d04-4998-b107-03fd3ddc2256-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:49:13.367852 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.367809 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" event={"ID":"1739357f-b8af-488c-a0f0-0e767e53ea90","Type":"ContainerStarted","Data":"a276a4169161f8120ca1172ec1f03ef0c805dc7c91ef2c3d22dce120889e95a3"} Jul 12 21:49:13.369672 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.369653 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" Jul 12 21:49:13.369787 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.369654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr9zpc" event={"ID":"c218680b-5d04-4998-b107-03fd3ddc2256","Type":"ContainerDied","Data":"89bbbd74da74cacdbab38a942c685ce584d6cfbd4397287236973d701343636e"} Jul 12 21:49:13.369787 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.369768 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89bbbd74da74cacdbab38a942c685ce584d6cfbd4397287236973d701343636e" Jul 12 21:49:13.371141 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.371118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" event={"ID":"f7d1035e-e76b-471a-8376-79b4512fd919","Type":"ContainerStarted","Data":"269aa4e97acd51fae5346d70174307f6565dac39b7d224b343f17d04982a279c"} Jul 12 21:49:13.371247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.371226 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:13.388087 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.388037 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vcxxf" podStartSLOduration=1.827498355 podStartE2EDuration="4.388024566s" totalImagesPullingTime="2.560526211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:49:13.387353322 +0000 UTC m=+293.094810479" watchObservedRunningTime="2026-07-12 21:49:13.388024566 +0000 UTC m=+293.095481729" Jul 12 21:49:13.415143 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:13.415094 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" podStartSLOduration=2.239338158 podStartE2EDuration="3.415075727s" totalImagesPullingTime="1.175737569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:49:13.413698607 +0000 UTC m=+293.121155789" watchObservedRunningTime="2026-07-12 21:49:13.415075727 +0000 UTC m=+293.122532890" Jul 12 21:49:19.377879 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.377848 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p6nlg" Jul 12 21:49:19.435912 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.435876 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw"] Jul 12 21:49:19.436494 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.436466 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c218680b-5d04-4998-b107-03fd3ddc2256" containerName="pull" Jul 12 21:49:19.436494 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.436492 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c218680b-5d04-4998-b107-03fd3ddc2256" containerName="pull" Jul 12 21:49:19.436652 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.436520 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c218680b-5d04-4998-b107-03fd3ddc2256" containerName="extract" Jul 12 21:49:19.436652 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.436532 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c218680b-5d04-4998-b107-03fd3ddc2256" containerName="extract" Jul 12 21:49:19.436652 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.436558 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c218680b-5d04-4998-b107-03fd3ddc2256" containerName="util" Jul 12 21:49:19.436652 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.436567 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c218680b-5d04-4998-b107-03fd3ddc2256" containerName="util" Jul 12 21:49:19.436652 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.436651 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c218680b-5d04-4998-b107-03fd3ddc2256" containerName="extract" Jul 12 21:49:19.478797 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.478770 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw"] Jul 12 21:49:19.478979 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.478856 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.481671 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.481647 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7c4jx\"" Jul 12 21:49:19.481812 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.481646 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 12 21:49:19.481812 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.481764 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 12 21:49:19.574805 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.574770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/901b355b-68ae-4939-9f4a-0e9a11e82f87-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rn6nw\" (UID: \"901b355b-68ae-4939-9f4a-0e9a11e82f87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.575022 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.574823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r848\" (UniqueName: \"kubernetes.io/projected/901b355b-68ae-4939-9f4a-0e9a11e82f87-kube-api-access-6r848\") pod \"openshift-lws-operator-fd8ccff4c-rn6nw\" (UID: \"901b355b-68ae-4939-9f4a-0e9a11e82f87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.675861 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.675768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/901b355b-68ae-4939-9f4a-0e9a11e82f87-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rn6nw\" (UID: \"901b355b-68ae-4939-9f4a-0e9a11e82f87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.675861 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.675821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r848\" (UniqueName: \"kubernetes.io/projected/901b355b-68ae-4939-9f4a-0e9a11e82f87-kube-api-access-6r848\") pod \"openshift-lws-operator-fd8ccff4c-rn6nw\" (UID: \"901b355b-68ae-4939-9f4a-0e9a11e82f87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.676168 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.676144 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/901b355b-68ae-4939-9f4a-0e9a11e82f87-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rn6nw\" (UID: \"901b355b-68ae-4939-9f4a-0e9a11e82f87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.684469 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.684445 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r848\" (UniqueName: \"kubernetes.io/projected/901b355b-68ae-4939-9f4a-0e9a11e82f87-kube-api-access-6r848\") pod \"openshift-lws-operator-fd8ccff4c-rn6nw\" (UID: \"901b355b-68ae-4939-9f4a-0e9a11e82f87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.787806 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.787773 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" Jul 12 21:49:19.954490 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:19.954251 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw"] Jul 12 21:49:20.406325 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:20.406287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" event={"ID":"901b355b-68ae-4939-9f4a-0e9a11e82f87","Type":"ContainerStarted","Data":"9e5d645c75b39ae6cd943e51bf1fecd3f562613587c470b47745e40276333adc"} Jul 12 21:49:20.900888 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:20.900861 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 12 21:49:23.424859 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:23.424821 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" event={"ID":"901b355b-68ae-4939-9f4a-0e9a11e82f87","Type":"ContainerStarted","Data":"d4ca310837c77a50d8419a19eb6aa9e53fe1e61b2152470badf61843418527bc"} Jul 12 21:49:23.443030 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:23.442979 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rn6nw" podStartSLOduration=2.061480565 podStartE2EDuration="4.442948563s" totalImagesPullingTime="2.381467998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:49:23.441012137 +0000 UTC m=+303.148469300" watchObservedRunningTime="2026-07-12 21:49:23.442948563 +0000 UTC m=+303.150405727" Jul 12 21:49:26.915497 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:26.915466 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf"] Jul 12 21:49:26.917834 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:26.917817 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:26.920522 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:26.920487 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 21:49:26.920522 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:26.920495 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 21:49:26.920725 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:26.920610 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dv6hl\"" Jul 12 21:49:26.930372 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:26.930350 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf"] Jul 12 21:49:27.040359 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.040325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.040566 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.040380 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.040566 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.040435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df97m\" (UniqueName: \"kubernetes.io/projected/8c5b32ef-04c0-4013-ac56-294fca8cf92a-kube-api-access-df97m\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.141795 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.141754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.142049 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.141811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.142049 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.141840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df97m\" (UniqueName: \"kubernetes.io/projected/8c5b32ef-04c0-4013-ac56-294fca8cf92a-kube-api-access-df97m\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.142263 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.142236 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.142310 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.142247 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.151415 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.151382 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df97m\" (UniqueName: \"kubernetes.io/projected/8c5b32ef-04c0-4013-ac56-294fca8cf92a-kube-api-access-df97m\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.226732 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.226654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:27.365015 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.364991 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf"] Jul 12 21:49:27.367581 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:49:27.367552 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5b32ef_04c0_4013_ac56_294fca8cf92a.slice/crio-6c519e5b95227fc19b631d0ea2217efe9ab394146fe42b0dc27b57995759dc15 WatchSource:0}: Error finding container 6c519e5b95227fc19b631d0ea2217efe9ab394146fe42b0dc27b57995759dc15: Status 404 returned error can't find the container with id 6c519e5b95227fc19b631d0ea2217efe9ab394146fe42b0dc27b57995759dc15 Jul 12 21:49:27.443441 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.443407 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" event={"ID":"8c5b32ef-04c0-4013-ac56-294fca8cf92a","Type":"ContainerStarted","Data":"3e09b26056f34e5d81c2d6288e72f266826fcfda387c9a4b7a9167fd08de99a8"} Jul 12 21:49:27.443557 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:27.443470 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" event={"ID":"8c5b32ef-04c0-4013-ac56-294fca8cf92a","Type":"ContainerStarted","Data":"6c519e5b95227fc19b631d0ea2217efe9ab394146fe42b0dc27b57995759dc15"} Jul 12 21:49:28.448778 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:28.448685 2573 generic.go:356] "Generic (PLEG): container finished" podID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerID="3e09b26056f34e5d81c2d6288e72f266826fcfda387c9a4b7a9167fd08de99a8" exitCode=0 Jul 12 21:49:28.449159 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:28.448774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" event={"ID":"8c5b32ef-04c0-4013-ac56-294fca8cf92a","Type":"ContainerDied","Data":"3e09b26056f34e5d81c2d6288e72f266826fcfda387c9a4b7a9167fd08de99a8"} Jul 12 21:49:28.454670 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:28.449794 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 21:49:29.455049 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:29.455010 2573 generic.go:356] "Generic (PLEG): container finished" podID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerID="6102c4fbf4aeec0870a3d06d314db5e52bd618f36fbd7a574a3bbb5062c086f2" exitCode=0 Jul 12 21:49:29.455452 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:29.455061 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" event={"ID":"8c5b32ef-04c0-4013-ac56-294fca8cf92a","Type":"ContainerDied","Data":"6102c4fbf4aeec0870a3d06d314db5e52bd618f36fbd7a574a3bbb5062c086f2"} Jul 12 21:49:30.461579 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:30.461543 2573 generic.go:356] "Generic (PLEG): container finished" podID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerID="b06c23f3928a1300f16e557f5c89be8c372c623d6a4e56a635eca399d15250fa" exitCode=0 Jul 12 21:49:30.462025 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:30.461629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" event={"ID":"8c5b32ef-04c0-4013-ac56-294fca8cf92a","Type":"ContainerDied","Data":"b06c23f3928a1300f16e557f5c89be8c372c623d6a4e56a635eca399d15250fa"} Jul 12 21:49:31.587518 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.587489 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:31.684553 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.684521 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df97m\" (UniqueName: \"kubernetes.io/projected/8c5b32ef-04c0-4013-ac56-294fca8cf92a-kube-api-access-df97m\") pod \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " Jul 12 21:49:31.684777 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.684567 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-util\") pod \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " Jul 12 21:49:31.684777 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.684629 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-bundle\") pod \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\" (UID: \"8c5b32ef-04c0-4013-ac56-294fca8cf92a\") " Jul 12 21:49:31.685430 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.685399 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-bundle" (OuterVolumeSpecName: "bundle") pod "8c5b32ef-04c0-4013-ac56-294fca8cf92a" (UID: "8c5b32ef-04c0-4013-ac56-294fca8cf92a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:49:31.686663 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.686638 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5b32ef-04c0-4013-ac56-294fca8cf92a-kube-api-access-df97m" (OuterVolumeSpecName: "kube-api-access-df97m") pod "8c5b32ef-04c0-4013-ac56-294fca8cf92a" (UID: "8c5b32ef-04c0-4013-ac56-294fca8cf92a"). InnerVolumeSpecName "kube-api-access-df97m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:49:31.690000 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.689978 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-util" (OuterVolumeSpecName: "util") pod "8c5b32ef-04c0-4013-ac56-294fca8cf92a" (UID: "8c5b32ef-04c0-4013-ac56-294fca8cf92a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:49:31.785682 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.785594 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:49:31.785682 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.785626 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df97m\" (UniqueName: \"kubernetes.io/projected/8c5b32ef-04c0-4013-ac56-294fca8cf92a-kube-api-access-df97m\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:49:31.785682 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:31.785636 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5b32ef-04c0-4013-ac56-294fca8cf92a-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:49:32.472873 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:32.472844 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" Jul 12 21:49:32.473086 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:32.472838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff92sf" event={"ID":"8c5b32ef-04c0-4013-ac56-294fca8cf92a","Type":"ContainerDied","Data":"6c519e5b95227fc19b631d0ea2217efe9ab394146fe42b0dc27b57995759dc15"} Jul 12 21:49:32.473086 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:32.473010 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c519e5b95227fc19b631d0ea2217efe9ab394146fe42b0dc27b57995759dc15" Jul 12 21:49:39.037140 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037101 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f"] Jul 12 21:49:39.037527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037447 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerName="extract" Jul 12 21:49:39.037527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037459 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerName="extract" Jul 12 21:49:39.037527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037470 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerName="util" Jul 12 21:49:39.037527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037475 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerName="util" Jul 12 21:49:39.037527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037491 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerName="pull" Jul 12 21:49:39.037527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037498 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerName="pull" Jul 12 21:49:39.037715 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.037553 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c5b32ef-04c0-4013-ac56-294fca8cf92a" containerName="extract" Jul 12 21:49:39.039987 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.039954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.043826 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.043801 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 12 21:49:39.044818 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.044800 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 12 21:49:39.044973 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.044941 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 12 21:49:39.045072 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.045055 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 12 21:49:39.045133 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.045089 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7vck4\"" Jul 12 21:49:39.070206 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.070176 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f"] Jul 12 21:49:39.143690 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.143646 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1ae7c1c-ca2f-421b-b597-25519623bc0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.143690 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.143690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1ae7c1c-ca2f-421b-b597-25519623bc0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.143897 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.143795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gtx\" (UniqueName: \"kubernetes.io/projected/f1ae7c1c-ca2f-421b-b597-25519623bc0f-kube-api-access-q9gtx\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.143897 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.143839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1ae7c1c-ca2f-421b-b597-25519623bc0f-manifests\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.143988 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.143901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1ae7c1c-ca2f-421b-b597-25519623bc0f-tmp\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.244681 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.244643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gtx\" (UniqueName: \"kubernetes.io/projected/f1ae7c1c-ca2f-421b-b597-25519623bc0f-kube-api-access-q9gtx\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.244887 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.244690 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1ae7c1c-ca2f-421b-b597-25519623bc0f-manifests\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.244887 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.244716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1ae7c1c-ca2f-421b-b597-25519623bc0f-tmp\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.244887 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.244762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1ae7c1c-ca2f-421b-b597-25519623bc0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.244887 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.244787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1ae7c1c-ca2f-421b-b597-25519623bc0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.245125 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.245084 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1ae7c1c-ca2f-421b-b597-25519623bc0f-manifests\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.247070 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.247043 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1ae7c1c-ca2f-421b-b597-25519623bc0f-tmp\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.247354 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.247337 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1ae7c1c-ca2f-421b-b597-25519623bc0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.247396 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.247367 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1ae7c1c-ca2f-421b-b597-25519623bc0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.253051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.253022 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gtx\" (UniqueName: \"kubernetes.io/projected/f1ae7c1c-ca2f-421b-b597-25519623bc0f-kube-api-access-q9gtx\") pod \"opendatahub-operator-controller-manager-5557dd54c4-dnv7f\" (UID: \"f1ae7c1c-ca2f-421b-b597-25519623bc0f\") " pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.351067 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.351015 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:39.487611 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.487586 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f"] Jul 12 21:49:39.490055 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:49:39.490029 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ae7c1c_ca2f_421b_b597_25519623bc0f.slice/crio-6f81548d4bd8291fc9861dc15485f505d88165788910e0a456e369a632c76648 WatchSource:0}: Error finding container 6f81548d4bd8291fc9861dc15485f505d88165788910e0a456e369a632c76648: Status 404 returned error can't find the container with id 6f81548d4bd8291fc9861dc15485f505d88165788910e0a456e369a632c76648 Jul 12 21:49:39.506513 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:39.506480 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" event={"ID":"f1ae7c1c-ca2f-421b-b597-25519623bc0f","Type":"ContainerStarted","Data":"6f81548d4bd8291fc9861dc15485f505d88165788910e0a456e369a632c76648"} Jul 12 21:49:43.530702 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:43.530661 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" event={"ID":"f1ae7c1c-ca2f-421b-b597-25519623bc0f","Type":"ContainerStarted","Data":"dfcc7400873b93c072c4d24dc9e24362c2ff850e768640c4be4d8d280e352760"} Jul 12 21:49:44.536914 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:44.536881 2573 generic.go:356] "Generic (PLEG): container finished" podID="f1ae7c1c-ca2f-421b-b597-25519623bc0f" containerID="dfcc7400873b93c072c4d24dc9e24362c2ff850e768640c4be4d8d280e352760" exitCode=0 Jul 12 21:49:44.537323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:44.536949 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" event={"ID":"f1ae7c1c-ca2f-421b-b597-25519623bc0f","Type":"ContainerDied","Data":"dfcc7400873b93c072c4d24dc9e24362c2ff850e768640c4be4d8d280e352760"} Jul 12 21:49:45.543977 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:45.543932 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" event={"ID":"f1ae7c1c-ca2f-421b-b597-25519623bc0f","Type":"ContainerStarted","Data":"b3cd43f27b2ec5d74f56ffb653a72c1e595c0f3395555e182823931ed9ba10c4"} Jul 12 21:49:45.544355 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:45.544041 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:49:45.566508 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:45.566450 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" podStartSLOduration=2.135932154 podStartE2EDuration="6.566431812s" totalImagesPullingTime="3.334679148s" totalInitContainerRuntime="1.09582051s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:49:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:49:45.565181127 +0000 UTC m=+325.272638290" watchObservedRunningTime="2026-07-12 21:49:45.566431812 +0000 UTC m=+325.273888977" Jul 12 21:49:56.555382 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:49:56.555350 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5557dd54c4-dnv7f" Jul 12 21:50:06.729559 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.729527 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69989bc466-hccm4"] Jul 12 21:50:06.738380 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.738358 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.742308 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.742281 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b4dps\"" Jul 12 21:50:06.742467 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.742281 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 12 21:50:06.742467 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.742308 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 12 21:50:06.742467 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.742335 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 12 21:50:06.746876 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.746850 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69989bc466-hccm4"] Jul 12 21:50:06.790578 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.790548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f454bec-abd1-482e-8365-fc313f9f18bf-cert\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.790757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.790589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pf68\" (UniqueName: \"kubernetes.io/projected/7f454bec-abd1-482e-8365-fc313f9f18bf-kube-api-access-4pf68\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.790757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.790635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f454bec-abd1-482e-8365-fc313f9f18bf-metrics-cert\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.790757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.790671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f454bec-abd1-482e-8365-fc313f9f18bf-manager-config\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.891320 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.891282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f454bec-abd1-482e-8365-fc313f9f18bf-metrics-cert\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.891320 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.891324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f454bec-abd1-482e-8365-fc313f9f18bf-manager-config\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.891571 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.891362 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f454bec-abd1-482e-8365-fc313f9f18bf-cert\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.891571 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.891380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pf68\" (UniqueName: \"kubernetes.io/projected/7f454bec-abd1-482e-8365-fc313f9f18bf-kube-api-access-4pf68\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.892101 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.892080 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f454bec-abd1-482e-8365-fc313f9f18bf-manager-config\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.893776 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.893750 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f454bec-abd1-482e-8365-fc313f9f18bf-metrics-cert\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.893933 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.893910 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f454bec-abd1-482e-8365-fc313f9f18bf-cert\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:06.900077 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:06.900057 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pf68\" (UniqueName: \"kubernetes.io/projected/7f454bec-abd1-482e-8365-fc313f9f18bf-kube-api-access-4pf68\") pod \"lws-controller-manager-69989bc466-hccm4\" (UID: \"7f454bec-abd1-482e-8365-fc313f9f18bf\") " pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:07.048260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:07.048180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:07.193277 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:07.193248 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69989bc466-hccm4"] Jul 12 21:50:07.195970 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:50:07.195923 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f454bec_abd1_482e_8365_fc313f9f18bf.slice/crio-20dca467694bfbadc05939e1ed78ba6c0dea7006f4f10705d7d69a49cceee915 WatchSource:0}: Error finding container 20dca467694bfbadc05939e1ed78ba6c0dea7006f4f10705d7d69a49cceee915: Status 404 returned error can't find the container with id 20dca467694bfbadc05939e1ed78ba6c0dea7006f4f10705d7d69a49cceee915 Jul 12 21:50:07.649878 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:07.649843 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" event={"ID":"7f454bec-abd1-482e-8365-fc313f9f18bf","Type":"ContainerStarted","Data":"20dca467694bfbadc05939e1ed78ba6c0dea7006f4f10705d7d69a49cceee915"} Jul 12 21:50:09.663627 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:09.663588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" event={"ID":"7f454bec-abd1-482e-8365-fc313f9f18bf","Type":"ContainerStarted","Data":"c6dc5c26858ec303fcb7a6cf6cc99196c0e74e7ba01275702a2b79fa66674991"} Jul 12 21:50:09.664047 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:09.663697 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:09.688443 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:09.688381 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" podStartSLOduration=2.139606326 podStartE2EDuration="3.688366967s" totalImagesPullingTime="1.548760641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:50:09.687867308 +0000 UTC m=+349.395324478" watchObservedRunningTime="2026-07-12 21:50:09.688366967 +0000 UTC m=+349.395824130" Jul 12 21:50:18.165410 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.165317 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh"] Jul 12 21:50:18.173908 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.173879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.176871 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.176847 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-46dbh\"" Jul 12 21:50:18.177489 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.177472 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 12 21:50:18.177802 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.177782 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 21:50:18.178064 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.178046 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 12 21:50:18.184919 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.184897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh"] Jul 12 21:50:18.292331 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292331 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwf8h\" (UniqueName: \"kubernetes.io/projected/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-kube-api-access-xwf8h\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292700 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292591 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.292700 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.292612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393273 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393273 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393271 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393505 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393505 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393505 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393817 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393665 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393817 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwf8h\" (UniqueName: \"kubernetes.io/projected/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-kube-api-access-xwf8h\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.393817 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.393755 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.394078 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.394052 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.394195 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.394086 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.394310 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.394289 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.395839 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.395810 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.395977 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.395870 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.401524 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.401504 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.401915 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.401894 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwf8h\" (UniqueName: \"kubernetes.io/projected/4536f46a-92a8-48ce-83a7-bc05f5a62b8d-kube-api-access-xwf8h\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p66kh\" (UID: \"4536f46a-92a8-48ce-83a7-bc05f5a62b8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.485614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.485518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:18.625220 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.625190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh"] Jul 12 21:50:18.627454 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:50:18.627421 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4536f46a_92a8_48ce_83a7_bc05f5a62b8d.slice/crio-db10f7768122dd4cacfd76c244b729f84c27be95cca59f9dc1561c375bbf56b3 WatchSource:0}: Error finding container db10f7768122dd4cacfd76c244b729f84c27be95cca59f9dc1561c375bbf56b3: Status 404 returned error can't find the container with id db10f7768122dd4cacfd76c244b729f84c27be95cca59f9dc1561c375bbf56b3 Jul 12 21:50:18.707639 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:18.707601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" event={"ID":"4536f46a-92a8-48ce-83a7-bc05f5a62b8d","Type":"ContainerStarted","Data":"db10f7768122dd4cacfd76c244b729f84c27be95cca59f9dc1561c375bbf56b3"} Jul 12 21:50:20.671177 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:20.671147 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69989bc466-hccm4" Jul 12 21:50:21.335833 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:21.335782 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:50:21.335981 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:21.335886 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:50:21.335981 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:21.335932 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:50:21.724646 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:21.724559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" event={"ID":"4536f46a-92a8-48ce-83a7-bc05f5a62b8d","Type":"ContainerStarted","Data":"4e00723e9f9cf2bbab73531e0eeaa3663da57c3354a4e97920e1982df6d25fe6"} Jul 12 21:50:21.745252 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:21.745193 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" podStartSLOduration=1.039167561 podStartE2EDuration="3.745176882s" totalImagesPullingTime="2.706009321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:50:21.743091948 +0000 UTC m=+361.450549108" watchObservedRunningTime="2026-07-12 21:50:21.745176882 +0000 UTC m=+361.452634046" Jul 12 21:50:22.486617 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:22.486580 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:22.491588 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:22.491562 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:22.729839 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:22.729805 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:22.730750 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:22.730731 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p66kh" Jul 12 21:50:59.822918 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:59.822880 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6tv9"] Jul 12 21:50:59.833090 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:59.833060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" Jul 12 21:50:59.835268 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:59.835232 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6tv9"] Jul 12 21:50:59.835648 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:59.835612 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 21:50:59.835780 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:59.835648 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 21:50:59.836698 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:59.836674 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4v57v\"" Jul 12 21:50:59.955859 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:50:59.955812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42czm\" (UniqueName: \"kubernetes.io/projected/23ca4bb7-6ee3-4f00-8638-6456a9f9c15b-kube-api-access-42czm\") pod \"kuadrant-operator-catalog-r6tv9\" (UID: \"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b\") " pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" Jul 12 21:51:00.057288 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.057197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42czm\" (UniqueName: \"kubernetes.io/projected/23ca4bb7-6ee3-4f00-8638-6456a9f9c15b-kube-api-access-42czm\") pod \"kuadrant-operator-catalog-r6tv9\" (UID: \"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b\") " pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" Jul 12 21:51:00.065126 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.065094 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42czm\" (UniqueName: \"kubernetes.io/projected/23ca4bb7-6ee3-4f00-8638-6456a9f9c15b-kube-api-access-42czm\") pod \"kuadrant-operator-catalog-r6tv9\" (UID: \"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b\") " pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" Jul 12 21:51:00.144419 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.144384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" Jul 12 21:51:00.186875 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.186828 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6tv9"] Jul 12 21:51:00.297059 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.297032 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6tv9"] Jul 12 21:51:00.299542 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:00.299517 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ca4bb7_6ee3_4f00_8638_6456a9f9c15b.slice/crio-106d6e1719ff39b4723a0ee549e28d04f6d2debbfa84102b9c9cb865b887a423 WatchSource:0}: Error finding container 106d6e1719ff39b4723a0ee549e28d04f6d2debbfa84102b9c9cb865b887a423: Status 404 returned error can't find the container with id 106d6e1719ff39b4723a0ee549e28d04f6d2debbfa84102b9c9cb865b887a423 Jul 12 21:51:00.396937 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.396896 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2st5m"] Jul 12 21:51:00.401874 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.401848 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:00.408581 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.408553 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2st5m"] Jul 12 21:51:00.460265 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.460228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v5d4\" (UniqueName: \"kubernetes.io/projected/e2ae5fa0-543e-4d80-bb02-7bebf38aaa99-kube-api-access-4v5d4\") pod \"kuadrant-operator-catalog-2st5m\" (UID: \"e2ae5fa0-543e-4d80-bb02-7bebf38aaa99\") " pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:00.561095 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.561053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v5d4\" (UniqueName: \"kubernetes.io/projected/e2ae5fa0-543e-4d80-bb02-7bebf38aaa99-kube-api-access-4v5d4\") pod \"kuadrant-operator-catalog-2st5m\" (UID: \"e2ae5fa0-543e-4d80-bb02-7bebf38aaa99\") " pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:00.569947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.569912 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v5d4\" (UniqueName: \"kubernetes.io/projected/e2ae5fa0-543e-4d80-bb02-7bebf38aaa99-kube-api-access-4v5d4\") pod \"kuadrant-operator-catalog-2st5m\" (UID: \"e2ae5fa0-543e-4d80-bb02-7bebf38aaa99\") " pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:00.718395 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.718308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:00.868998 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.868954 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2st5m"] Jul 12 21:51:00.870941 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:00.870907 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ae5fa0_543e_4d80_bb02_7bebf38aaa99.slice/crio-cd9a380f88de8d74ff648a5bf6165bc62eb067789cb3f0c85ebd6f923e0c478f WatchSource:0}: Error finding container cd9a380f88de8d74ff648a5bf6165bc62eb067789cb3f0c85ebd6f923e0c478f: Status 404 returned error can't find the container with id cd9a380f88de8d74ff648a5bf6165bc62eb067789cb3f0c85ebd6f923e0c478f Jul 12 21:51:00.916976 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.916934 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" event={"ID":"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b","Type":"ContainerStarted","Data":"106d6e1719ff39b4723a0ee549e28d04f6d2debbfa84102b9c9cb865b887a423"} Jul 12 21:51:00.917953 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:00.917930 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" event={"ID":"e2ae5fa0-543e-4d80-bb02-7bebf38aaa99","Type":"ContainerStarted","Data":"cd9a380f88de8d74ff648a5bf6165bc62eb067789cb3f0c85ebd6f923e0c478f"} Jul 12 21:51:02.929450 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:02.929414 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" event={"ID":"e2ae5fa0-543e-4d80-bb02-7bebf38aaa99","Type":"ContainerStarted","Data":"af47bf497da29d03b296d1b9238d8a7c2e7a915ac9cc8978c1f082ed52f6fb68"} Jul 12 21:51:02.930871 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:02.930847 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" event={"ID":"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b","Type":"ContainerStarted","Data":"c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5"} Jul 12 21:51:02.930988 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:02.930878 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" podUID="23ca4bb7-6ee3-4f00-8638-6456a9f9c15b" containerName="registry-server" containerID="cri-o://c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5" gracePeriod=2 Jul 12 21:51:02.946906 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:02.946860 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" podStartSLOduration=1.490566549 podStartE2EDuration="2.94684408s" totalImagesPullingTime="1.456277531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:51:02.945203437 +0000 UTC m=+402.652660614" watchObservedRunningTime="2026-07-12 21:51:02.94684408 +0000 UTC m=+402.654301243" Jul 12 21:51:02.962552 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:02.962510 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" podStartSLOduration=1.9523484610000001 podStartE2EDuration="3.96249608s" totalImagesPullingTime="2.010147619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:51:02.96067579 +0000 UTC m=+402.668132978" watchObservedRunningTime="2026-07-12 21:51:02.96249608 +0000 UTC m=+402.669953243" Jul 12 21:51:03.179509 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.179449 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" Jul 12 21:51:03.287407 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.287372 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42czm\" (UniqueName: \"kubernetes.io/projected/23ca4bb7-6ee3-4f00-8638-6456a9f9c15b-kube-api-access-42czm\") pod \"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b\" (UID: \"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b\") " Jul 12 21:51:03.289586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.289560 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ca4bb7-6ee3-4f00-8638-6456a9f9c15b-kube-api-access-42czm" (OuterVolumeSpecName: "kube-api-access-42czm") pod "23ca4bb7-6ee3-4f00-8638-6456a9f9c15b" (UID: "23ca4bb7-6ee3-4f00-8638-6456a9f9c15b"). InnerVolumeSpecName "kube-api-access-42czm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:51:03.388123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.388088 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42czm\" (UniqueName: \"kubernetes.io/projected/23ca4bb7-6ee3-4f00-8638-6456a9f9c15b-kube-api-access-42czm\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:03.937292 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.937257 2573 generic.go:356] "Generic (PLEG): container finished" podID="23ca4bb7-6ee3-4f00-8638-6456a9f9c15b" containerID="c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5" exitCode=0 Jul 12 21:51:03.937292 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.937300 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" Jul 12 21:51:03.937793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.937342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" event={"ID":"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b","Type":"ContainerDied","Data":"c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5"} Jul 12 21:51:03.937793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.937390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6tv9" event={"ID":"23ca4bb7-6ee3-4f00-8638-6456a9f9c15b","Type":"ContainerDied","Data":"106d6e1719ff39b4723a0ee549e28d04f6d2debbfa84102b9c9cb865b887a423"} Jul 12 21:51:03.937793 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.937416 2573 scope.go:117] "RemoveContainer" containerID="c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5" Jul 12 21:51:03.947072 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.947055 2573 scope.go:117] "RemoveContainer" containerID="c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5" Jul 12 21:51:03.947542 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:51:03.947496 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5\": container with ID starting with c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5 not found: ID does not exist" containerID="c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5" Jul 12 21:51:03.947653 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.947537 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5"} err="failed to get container status \"c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5\": rpc error: code = NotFound desc = could not find container \"c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5\": container with ID starting with c36d9a552f32b2f9c285f524f0bd01791a112ce9dc5cf6aa0c44fb558d386ee5 not found: ID does not exist" Jul 12 21:51:03.966648 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.966545 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6tv9"] Jul 12 21:51:03.970077 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:03.970013 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6tv9"] Jul 12 21:51:05.000439 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:05.000409 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ca4bb7-6ee3-4f00-8638-6456a9f9c15b" path="/var/lib/kubelet/pods/23ca4bb7-6ee3-4f00-8638-6456a9f9c15b/volumes" Jul 12 21:51:10.719085 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:10.719048 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:10.719525 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:10.719364 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:10.741806 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:10.741774 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:10.999635 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:10.999548 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2st5m" Jul 12 21:51:15.151082 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.151044 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j"] Jul 12 21:51:15.151463 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.151395 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ca4bb7-6ee3-4f00-8638-6456a9f9c15b" containerName="registry-server" Jul 12 21:51:15.151463 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.151405 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ca4bb7-6ee3-4f00-8638-6456a9f9c15b" containerName="registry-server" Jul 12 21:51:15.151533 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.151477 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ca4bb7-6ee3-4f00-8638-6456a9f9c15b" containerName="registry-server" Jul 12 21:51:15.154494 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.154477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.157298 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.157274 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j4wpg\"" Jul 12 21:51:15.163746 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.163723 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j"] Jul 12 21:51:15.293946 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.293906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.294231 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.293957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.294231 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.294140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxw26\" (UniqueName: \"kubernetes.io/projected/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-kube-api-access-qxw26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.395373 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.395339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.395531 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.395381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.395531 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.395444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxw26\" (UniqueName: \"kubernetes.io/projected/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-kube-api-access-qxw26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.395791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.395767 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.395852 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.395833 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.403646 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.403591 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxw26\" (UniqueName: \"kubernetes.io/projected/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-kube-api-access-qxw26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.464175 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.464142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:15.598320 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.598211 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j"] Jul 12 21:51:15.600554 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:15.600526 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1bfc58_74d0_4764_b5cc_1d5e466d6e93.slice/crio-2a4f1557868c83f9a4dbc1d789fa086a7877be6cf26e2e8a65822256ed59e1b9 WatchSource:0}: Error finding container 2a4f1557868c83f9a4dbc1d789fa086a7877be6cf26e2e8a65822256ed59e1b9: Status 404 returned error can't find the container with id 2a4f1557868c83f9a4dbc1d789fa086a7877be6cf26e2e8a65822256ed59e1b9 Jul 12 21:51:15.724731 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:51:15.724691 2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1bfc58_74d0_4764_b5cc_1d5e466d6e93.slice/crio-conmon-67897c3b8fcdf3e134ef67f65181342abbde08561f5d9eedb8e522fd3abf3fad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1bfc58_74d0_4764_b5cc_1d5e466d6e93.slice/crio-67897c3b8fcdf3e134ef67f65181342abbde08561f5d9eedb8e522fd3abf3fad.scope\": RecentStats: unable to find data in memory cache]" Jul 12 21:51:15.748221 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.748186 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v"] Jul 12 21:51:15.751658 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.751642 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:15.760291 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.760265 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v"] Jul 12 21:51:15.898954 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.898911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5j6p\" (UniqueName: \"kubernetes.io/projected/7d264cec-b1e6-411b-94d8-e03301b19479-kube-api-access-k5j6p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:15.898954 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.898982 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:15.899220 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.899030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:15.998102 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.998016 2573 generic.go:356] "Generic (PLEG): container finished" podID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerID="67897c3b8fcdf3e134ef67f65181342abbde08561f5d9eedb8e522fd3abf3fad" exitCode=0 Jul 12 21:51:15.998102 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.998093 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" event={"ID":"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93","Type":"ContainerDied","Data":"67897c3b8fcdf3e134ef67f65181342abbde08561f5d9eedb8e522fd3abf3fad"} Jul 12 21:51:15.998332 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:15.998134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" event={"ID":"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93","Type":"ContainerStarted","Data":"2a4f1557868c83f9a4dbc1d789fa086a7877be6cf26e2e8a65822256ed59e1b9"} Jul 12 21:51:16.000210 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.000187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5j6p\" (UniqueName: \"kubernetes.io/projected/7d264cec-b1e6-411b-94d8-e03301b19479-kube-api-access-k5j6p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:16.000319 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.000220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:16.000319 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.000257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:16.000597 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.000580 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:16.000665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.000609 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:16.008349 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.008331 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5j6p\" (UniqueName: \"kubernetes.io/projected/7d264cec-b1e6-411b-94d8-e03301b19479-kube-api-access-k5j6p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:16.061261 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.061217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:16.194757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.194725 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v"] Jul 12 21:51:16.196798 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:16.196772 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d264cec_b1e6_411b_94d8_e03301b19479.slice/crio-ea2c3cf1e487235b15cc73bc6775bcc6e707d53fd4c69b7578b78ae6931a8478 WatchSource:0}: Error finding container ea2c3cf1e487235b15cc73bc6775bcc6e707d53fd4c69b7578b78ae6931a8478: Status 404 returned error can't find the container with id ea2c3cf1e487235b15cc73bc6775bcc6e707d53fd4c69b7578b78ae6931a8478 Jul 12 21:51:16.344767 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.344729 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9"] Jul 12 21:51:16.348322 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.348307 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.357213 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.357186 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9"] Jul 12 21:51:16.505013 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.504913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlttx\" (UniqueName: \"kubernetes.io/projected/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-kube-api-access-dlttx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.505013 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.504995 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.505228 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.505069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.606232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.606204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.606359 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.606290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.606359 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.606324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlttx\" (UniqueName: \"kubernetes.io/projected/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-kube-api-access-dlttx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.606614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.606597 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.606694 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.606675 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.614296 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.614276 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlttx\" (UniqueName: \"kubernetes.io/projected/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-kube-api-access-dlttx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.662041 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.662014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:16.755752 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.755677 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh"] Jul 12 21:51:16.760486 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.760464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:16.769034 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.769002 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh"] Jul 12 21:51:16.800262 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.800238 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9"] Jul 12 21:51:16.802262 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:16.802233 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2a5f53_a0cc_449a_9cbd_f7d064a628aa.slice/crio-f65b01115e28cae045327624c4e87cc8b0403ff7b15816c568b0e2c1fca259ab WatchSource:0}: Error finding container f65b01115e28cae045327624c4e87cc8b0403ff7b15816c568b0e2c1fca259ab: Status 404 returned error can't find the container with id f65b01115e28cae045327624c4e87cc8b0403ff7b15816c568b0e2c1fca259ab Jul 12 21:51:16.909219 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.909186 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dl9t\" (UniqueName: \"kubernetes.io/projected/4a986dfc-b9c6-4744-b104-927880558339-kube-api-access-9dl9t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:16.909340 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.909298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:16.909375 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:16.909365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.004343 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.004310 2573 generic.go:356] "Generic (PLEG): container finished" podID="7d264cec-b1e6-411b-94d8-e03301b19479" containerID="5946cf3d6db209dd722f79d62bbb4061b3db757830e39d98aac0b2e30d44a439" exitCode=0 Jul 12 21:51:17.004532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.004396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" event={"ID":"7d264cec-b1e6-411b-94d8-e03301b19479","Type":"ContainerDied","Data":"5946cf3d6db209dd722f79d62bbb4061b3db757830e39d98aac0b2e30d44a439"} Jul 12 21:51:17.004532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.004447 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" event={"ID":"7d264cec-b1e6-411b-94d8-e03301b19479","Type":"ContainerStarted","Data":"ea2c3cf1e487235b15cc73bc6775bcc6e707d53fd4c69b7578b78ae6931a8478"} Jul 12 21:51:17.006070 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.005998 2573 generic.go:356] "Generic (PLEG): container finished" podID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerID="4f1687da3f75ad667956ddc371042949a2d0b165908c3561582ca09492efd8c6" exitCode=0 Jul 12 21:51:17.006070 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.006027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" event={"ID":"de2a5f53-a0cc-449a-9cbd-f7d064a628aa","Type":"ContainerDied","Data":"4f1687da3f75ad667956ddc371042949a2d0b165908c3561582ca09492efd8c6"} Jul 12 21:51:17.006213 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.006076 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" event={"ID":"de2a5f53-a0cc-449a-9cbd-f7d064a628aa","Type":"ContainerStarted","Data":"f65b01115e28cae045327624c4e87cc8b0403ff7b15816c568b0e2c1fca259ab"} Jul 12 21:51:17.008131 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.008098 2573 generic.go:356] "Generic (PLEG): container finished" podID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerID="1a2f249618277d33550ec8fb832b42c96dd94143eac42b68e6ef541a34e712a7" exitCode=0 Jul 12 21:51:17.008207 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.008154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" event={"ID":"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93","Type":"ContainerDied","Data":"1a2f249618277d33550ec8fb832b42c96dd94143eac42b68e6ef541a34e712a7"} Jul 12 21:51:17.009754 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.009735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.009822 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.009790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.009863 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.009839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dl9t\" (UniqueName: \"kubernetes.io/projected/4a986dfc-b9c6-4744-b104-927880558339-kube-api-access-9dl9t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.010190 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.010157 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.010281 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.010209 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.020703 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.020648 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dl9t\" (UniqueName: \"kubernetes.io/projected/4a986dfc-b9c6-4744-b104-927880558339-kube-api-access-9dl9t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.076201 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.076179 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:17.217818 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:17.217786 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh"] Jul 12 21:51:17.219130 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:17.219097 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a986dfc_b9c6_4744_b104_927880558339.slice/crio-b5b27072f2be72ce1133ddcb2c3d0a104b2e89badd9428024ae3b280cfa038d2 WatchSource:0}: Error finding container b5b27072f2be72ce1133ddcb2c3d0a104b2e89badd9428024ae3b280cfa038d2: Status 404 returned error can't find the container with id b5b27072f2be72ce1133ddcb2c3d0a104b2e89badd9428024ae3b280cfa038d2 Jul 12 21:51:18.017527 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.017494 2573 generic.go:356] "Generic (PLEG): container finished" podID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerID="723af024be5a3172b5de96de458fb47e8138169177e39be9e8cd6f91d5959c31" exitCode=0 Jul 12 21:51:18.017673 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.017574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" event={"ID":"de2a5f53-a0cc-449a-9cbd-f7d064a628aa","Type":"ContainerDied","Data":"723af024be5a3172b5de96de458fb47e8138169177e39be9e8cd6f91d5959c31"} Jul 12 21:51:18.019166 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.019089 2573 generic.go:356] "Generic (PLEG): container finished" podID="4a986dfc-b9c6-4744-b104-927880558339" containerID="020ebdca42fc893ccef4dc6423fc10953b549e275db01ad1952e0dffa5a1d2fd" exitCode=0 Jul 12 21:51:18.019242 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.019157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" event={"ID":"4a986dfc-b9c6-4744-b104-927880558339","Type":"ContainerDied","Data":"020ebdca42fc893ccef4dc6423fc10953b549e275db01ad1952e0dffa5a1d2fd"} Jul 12 21:51:18.019242 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.019197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" event={"ID":"4a986dfc-b9c6-4744-b104-927880558339","Type":"ContainerStarted","Data":"b5b27072f2be72ce1133ddcb2c3d0a104b2e89badd9428024ae3b280cfa038d2"} Jul 12 21:51:18.021457 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.021435 2573 generic.go:356] "Generic (PLEG): container finished" podID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerID="74761078a377f1cb5137a6f2d45ae8df33d5514daa98fd193577521debb056ab" exitCode=0 Jul 12 21:51:18.021534 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.021497 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" event={"ID":"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93","Type":"ContainerDied","Data":"74761078a377f1cb5137a6f2d45ae8df33d5514daa98fd193577521debb056ab"} Jul 12 21:51:18.023429 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.023409 2573 generic.go:356] "Generic (PLEG): container finished" podID="7d264cec-b1e6-411b-94d8-e03301b19479" containerID="e3896d40ada9421d7d5482da37fe15f1d2581befc61e2dfebd6022e9703e6f0e" exitCode=0 Jul 12 21:51:18.023519 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:18.023454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" event={"ID":"7d264cec-b1e6-411b-94d8-e03301b19479","Type":"ContainerDied","Data":"e3896d40ada9421d7d5482da37fe15f1d2581befc61e2dfebd6022e9703e6f0e"} Jul 12 21:51:19.031244 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.031211 2573 generic.go:356] "Generic (PLEG): container finished" podID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerID="4dc6c9e679bff54cf81cc567ee1840cd88db7f683814ac18bff3a2fe5006587b" exitCode=0 Jul 12 21:51:19.031663 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.031298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" event={"ID":"de2a5f53-a0cc-449a-9cbd-f7d064a628aa","Type":"ContainerDied","Data":"4dc6c9e679bff54cf81cc567ee1840cd88db7f683814ac18bff3a2fe5006587b"} Jul 12 21:51:19.036757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.036724 2573 generic.go:356] "Generic (PLEG): container finished" podID="7d264cec-b1e6-411b-94d8-e03301b19479" containerID="cac9e33306899933861856c612530b1e387d2070bafaaeedbec05f380fdbb298" exitCode=0 Jul 12 21:51:19.036898 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.036810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" event={"ID":"7d264cec-b1e6-411b-94d8-e03301b19479","Type":"ContainerDied","Data":"cac9e33306899933861856c612530b1e387d2070bafaaeedbec05f380fdbb298"} Jul 12 21:51:19.183515 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.183492 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:19.333386 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.333358 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-bundle\") pod \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " Jul 12 21:51:19.333541 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.333436 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-util\") pod \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " Jul 12 21:51:19.333541 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.333469 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxw26\" (UniqueName: \"kubernetes.io/projected/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-kube-api-access-qxw26\") pod \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\" (UID: \"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93\") " Jul 12 21:51:19.333976 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.333937 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-bundle" (OuterVolumeSpecName: "bundle") pod "cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" (UID: "cc1bfc58-74d0-4764-b5cc-1d5e466d6e93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:19.335551 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.335522 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-kube-api-access-qxw26" (OuterVolumeSpecName: "kube-api-access-qxw26") pod "cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" (UID: "cc1bfc58-74d0-4764-b5cc-1d5e466d6e93"). InnerVolumeSpecName "kube-api-access-qxw26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:51:19.338743 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.338710 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-util" (OuterVolumeSpecName: "util") pod "cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" (UID: "cc1bfc58-74d0-4764-b5cc-1d5e466d6e93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:19.434561 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.434523 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:19.434561 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.434555 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxw26\" (UniqueName: \"kubernetes.io/projected/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-kube-api-access-qxw26\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:19.434561 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:19.434565 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1bfc58-74d0-4764-b5cc-1d5e466d6e93-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:20.043838 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.043801 2573 generic.go:356] "Generic (PLEG): container finished" podID="4a986dfc-b9c6-4744-b104-927880558339" containerID="a8324e2420171f36b044cfb62eeb4a10a436680357c2b797db443f68aee469d7" exitCode=0 Jul 12 21:51:20.044310 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.043887 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" event={"ID":"4a986dfc-b9c6-4744-b104-927880558339","Type":"ContainerDied","Data":"a8324e2420171f36b044cfb62eeb4a10a436680357c2b797db443f68aee469d7"} Jul 12 21:51:20.045975 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.045943 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" Jul 12 21:51:20.046057 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.045987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j" event={"ID":"cc1bfc58-74d0-4764-b5cc-1d5e466d6e93","Type":"ContainerDied","Data":"2a4f1557868c83f9a4dbc1d789fa086a7877be6cf26e2e8a65822256ed59e1b9"} Jul 12 21:51:20.046057 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.046025 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a4f1557868c83f9a4dbc1d789fa086a7877be6cf26e2e8a65822256ed59e1b9" Jul 12 21:51:20.260638 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.260610 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:20.278564 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.278533 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:20.443799 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.443744 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-util\") pod \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " Jul 12 21:51:20.444029 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.443822 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5j6p\" (UniqueName: \"kubernetes.io/projected/7d264cec-b1e6-411b-94d8-e03301b19479-kube-api-access-k5j6p\") pod \"7d264cec-b1e6-411b-94d8-e03301b19479\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " Jul 12 21:51:20.444029 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.443845 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-bundle\") pod \"7d264cec-b1e6-411b-94d8-e03301b19479\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " Jul 12 21:51:20.444029 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.443914 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-util\") pod \"7d264cec-b1e6-411b-94d8-e03301b19479\" (UID: \"7d264cec-b1e6-411b-94d8-e03301b19479\") " Jul 12 21:51:20.444029 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.443931 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlttx\" (UniqueName: \"kubernetes.io/projected/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-kube-api-access-dlttx\") pod \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " Jul 12 21:51:20.444029 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.443956 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-bundle\") pod \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\" (UID: \"de2a5f53-a0cc-449a-9cbd-f7d064a628aa\") " Jul 12 21:51:20.444554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.444517 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-bundle" (OuterVolumeSpecName: "bundle") pod "de2a5f53-a0cc-449a-9cbd-f7d064a628aa" (UID: "de2a5f53-a0cc-449a-9cbd-f7d064a628aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:20.444749 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.444711 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-bundle" (OuterVolumeSpecName: "bundle") pod "7d264cec-b1e6-411b-94d8-e03301b19479" (UID: "7d264cec-b1e6-411b-94d8-e03301b19479"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:20.446095 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.446070 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d264cec-b1e6-411b-94d8-e03301b19479-kube-api-access-k5j6p" (OuterVolumeSpecName: "kube-api-access-k5j6p") pod "7d264cec-b1e6-411b-94d8-e03301b19479" (UID: "7d264cec-b1e6-411b-94d8-e03301b19479"). InnerVolumeSpecName "kube-api-access-k5j6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:51:20.446189 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.446152 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-kube-api-access-dlttx" (OuterVolumeSpecName: "kube-api-access-dlttx") pod "de2a5f53-a0cc-449a-9cbd-f7d064a628aa" (UID: "de2a5f53-a0cc-449a-9cbd-f7d064a628aa"). InnerVolumeSpecName "kube-api-access-dlttx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:51:20.450062 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.450042 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-util" (OuterVolumeSpecName: "util") pod "7d264cec-b1e6-411b-94d8-e03301b19479" (UID: "7d264cec-b1e6-411b-94d8-e03301b19479"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:20.450170 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.450153 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-util" (OuterVolumeSpecName: "util") pod "de2a5f53-a0cc-449a-9cbd-f7d064a628aa" (UID: "de2a5f53-a0cc-449a-9cbd-f7d064a628aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:20.545455 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.545410 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:20.545455 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.545453 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlttx\" (UniqueName: \"kubernetes.io/projected/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-kube-api-access-dlttx\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:20.545455 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.545462 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:20.545455 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.545470 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2a5f53-a0cc-449a-9cbd-f7d064a628aa-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:20.545755 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.545478 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5j6p\" (UniqueName: \"kubernetes.io/projected/7d264cec-b1e6-411b-94d8-e03301b19479-kube-api-access-k5j6p\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:20.545755 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:20.545488 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d264cec-b1e6-411b-94d8-e03301b19479-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:21.052468 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.052433 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" Jul 12 21:51:21.052883 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.052425 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9" event={"ID":"de2a5f53-a0cc-449a-9cbd-f7d064a628aa","Type":"ContainerDied","Data":"f65b01115e28cae045327624c4e87cc8b0403ff7b15816c568b0e2c1fca259ab"} Jul 12 21:51:21.052883 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.052555 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f65b01115e28cae045327624c4e87cc8b0403ff7b15816c568b0e2c1fca259ab" Jul 12 21:51:21.054779 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.054632 2573 generic.go:356] "Generic (PLEG): container finished" podID="4a986dfc-b9c6-4744-b104-927880558339" containerID="0bdee946cca23ab3d69599bd0f225dabde36e922abf1085f5cc60f7c3ba89464" exitCode=0 Jul 12 21:51:21.054779 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.054767 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" event={"ID":"4a986dfc-b9c6-4744-b104-927880558339","Type":"ContainerDied","Data":"0bdee946cca23ab3d69599bd0f225dabde36e922abf1085f5cc60f7c3ba89464"} Jul 12 21:51:21.056603 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.056586 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" Jul 12 21:51:21.056714 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.056596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v" event={"ID":"7d264cec-b1e6-411b-94d8-e03301b19479","Type":"ContainerDied","Data":"ea2c3cf1e487235b15cc73bc6775bcc6e707d53fd4c69b7578b78ae6931a8478"} Jul 12 21:51:21.056714 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:21.056634 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea2c3cf1e487235b15cc73bc6775bcc6e707d53fd4c69b7578b78ae6931a8478" Jul 12 21:51:22.194584 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.194556 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:22.360922 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.360888 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dl9t\" (UniqueName: \"kubernetes.io/projected/4a986dfc-b9c6-4744-b104-927880558339-kube-api-access-9dl9t\") pod \"4a986dfc-b9c6-4744-b104-927880558339\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " Jul 12 21:51:22.361098 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.360946 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-bundle\") pod \"4a986dfc-b9c6-4744-b104-927880558339\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " Jul 12 21:51:22.361098 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.361073 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-util\") pod \"4a986dfc-b9c6-4744-b104-927880558339\" (UID: \"4a986dfc-b9c6-4744-b104-927880558339\") " Jul 12 21:51:22.361523 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.361488 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-bundle" (OuterVolumeSpecName: "bundle") pod "4a986dfc-b9c6-4744-b104-927880558339" (UID: "4a986dfc-b9c6-4744-b104-927880558339"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:22.363040 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.363019 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a986dfc-b9c6-4744-b104-927880558339-kube-api-access-9dl9t" (OuterVolumeSpecName: "kube-api-access-9dl9t") pod "4a986dfc-b9c6-4744-b104-927880558339" (UID: "4a986dfc-b9c6-4744-b104-927880558339"). InnerVolumeSpecName "kube-api-access-9dl9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:51:22.366568 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.366528 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-util" (OuterVolumeSpecName: "util") pod "4a986dfc-b9c6-4744-b104-927880558339" (UID: "4a986dfc-b9c6-4744-b104-927880558339"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:51:22.462047 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.462010 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dl9t\" (UniqueName: \"kubernetes.io/projected/4a986dfc-b9c6-4744-b104-927880558339-kube-api-access-9dl9t\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:22.462047 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.462041 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:22.462047 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:22.462050 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a986dfc-b9c6-4744-b104-927880558339-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:51:23.068660 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:23.068637 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" Jul 12 21:51:23.068826 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:23.068654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh" event={"ID":"4a986dfc-b9c6-4744-b104-927880558339","Type":"ContainerDied","Data":"b5b27072f2be72ce1133ddcb2c3d0a104b2e89badd9428024ae3b280cfa038d2"} Jul 12 21:51:23.068826 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:23.068704 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5b27072f2be72ce1133ddcb2c3d0a104b2e89badd9428024ae3b280cfa038d2" Jul 12 21:51:29.685190 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685154 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-744df6c7f6-dhzgg"] Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685495 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d264cec-b1e6-411b-94d8-e03301b19479" containerName="util" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685506 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d264cec-b1e6-411b-94d8-e03301b19479" containerName="util" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685516 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerName="extract" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685523 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerName="extract" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685529 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerName="pull" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685535 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerName="pull" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685541 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a986dfc-b9c6-4744-b104-927880558339" containerName="extract" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685546 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a986dfc-b9c6-4744-b104-927880558339" containerName="extract" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685556 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerName="util" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685561 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerName="util" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685566 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a986dfc-b9c6-4744-b104-927880558339" containerName="util" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685571 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a986dfc-b9c6-4744-b104-927880558339" containerName="util" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685584 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d264cec-b1e6-411b-94d8-e03301b19479" containerName="extract" Jul 12 21:51:29.685586 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685589 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d264cec-b1e6-411b-94d8-e03301b19479" containerName="extract" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685596 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerName="util" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685601 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerName="util" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685607 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a986dfc-b9c6-4744-b104-927880558339" containerName="pull" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685612 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a986dfc-b9c6-4744-b104-927880558339" containerName="pull" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685619 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerName="pull" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685624 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerName="pull" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685631 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d264cec-b1e6-411b-94d8-e03301b19479" containerName="pull" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685637 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d264cec-b1e6-411b-94d8-e03301b19479" containerName="pull" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685643 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerName="extract" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685649 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerName="extract" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685702 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d264cec-b1e6-411b-94d8-e03301b19479" containerName="extract" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685711 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a986dfc-b9c6-4744-b104-927880558339" containerName="extract" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685718 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1bfc58-74d0-4764-b5cc-1d5e466d6e93" containerName="extract" Jul 12 21:51:29.685995 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.685724 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="de2a5f53-a0cc-449a-9cbd-f7d064a628aa" containerName="extract" Jul 12 21:51:29.688955 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.688936 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.699644 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.699616 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744df6c7f6-dhzgg"] Jul 12 21:51:29.720317 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.720287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-service-ca\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.720432 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.720331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/936553f9-e80a-4f09-95ec-c82ac0669c94-console-oauth-config\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.720432 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.720355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlplf\" (UniqueName: \"kubernetes.io/projected/936553f9-e80a-4f09-95ec-c82ac0669c94-kube-api-access-jlplf\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.720432 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.720398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-trusted-ca-bundle\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.720432 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.720425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-console-config\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.720568 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.720443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/936553f9-e80a-4f09-95ec-c82ac0669c94-console-serving-cert\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.720568 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.720466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-oauth-serving-cert\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.820893 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.820859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlplf\" (UniqueName: \"kubernetes.io/projected/936553f9-e80a-4f09-95ec-c82ac0669c94-kube-api-access-jlplf\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821135 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.820906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-trusted-ca-bundle\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821135 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.820944 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-console-config\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821135 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.820996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/936553f9-e80a-4f09-95ec-c82ac0669c94-console-serving-cert\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.821223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-oauth-serving-cert\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821319 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.821305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-service-ca\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821380 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.821345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/936553f9-e80a-4f09-95ec-c82ac0669c94-console-oauth-config\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821873 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.821815 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-console-config\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821956 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.821831 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-oauth-serving-cert\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821956 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.821893 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-trusted-ca-bundle\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.821956 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.821921 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/936553f9-e80a-4f09-95ec-c82ac0669c94-service-ca\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.823485 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.823467 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/936553f9-e80a-4f09-95ec-c82ac0669c94-console-serving-cert\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.823556 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.823540 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/936553f9-e80a-4f09-95ec-c82ac0669c94-console-oauth-config\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.833657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.833630 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlplf\" (UniqueName: \"kubernetes.io/projected/936553f9-e80a-4f09-95ec-c82ac0669c94-kube-api-access-jlplf\") pod \"console-744df6c7f6-dhzgg\" (UID: \"936553f9-e80a-4f09-95ec-c82ac0669c94\") " pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:29.998665 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:29.998584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:30.135055 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:30.135029 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744df6c7f6-dhzgg"] Jul 12 21:51:30.137122 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:30.137097 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936553f9_e80a_4f09_95ec_c82ac0669c94.slice/crio-79862a17f123e6eea469e86b7e52722a53e03a1ae1c33e9553700bc3e93d3e70 WatchSource:0}: Error finding container 79862a17f123e6eea469e86b7e52722a53e03a1ae1c33e9553700bc3e93d3e70: Status 404 returned error can't find the container with id 79862a17f123e6eea469e86b7e52722a53e03a1ae1c33e9553700bc3e93d3e70 Jul 12 21:51:31.110655 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:31.110619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744df6c7f6-dhzgg" event={"ID":"936553f9-e80a-4f09-95ec-c82ac0669c94","Type":"ContainerStarted","Data":"560f0e51689c0689b519e28531af077822548812f30b0e6d5b5c20953fecb32b"} Jul 12 21:51:31.111139 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:31.110674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744df6c7f6-dhzgg" event={"ID":"936553f9-e80a-4f09-95ec-c82ac0669c94","Type":"ContainerStarted","Data":"79862a17f123e6eea469e86b7e52722a53e03a1ae1c33e9553700bc3e93d3e70"} Jul 12 21:51:31.129881 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:31.129828 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-744df6c7f6-dhzgg" podStartSLOduration=2.129813945 podStartE2EDuration="2.129813945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:51:31.126888645 +0000 UTC m=+430.834345816" watchObservedRunningTime="2026-07-12 21:51:31.129813945 +0000 UTC m=+430.837271109" Jul 12 21:51:34.119773 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.119737 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99"] Jul 12 21:51:34.124621 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.124599 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:51:34.127014 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.126992 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z4csf\"" Jul 12 21:51:34.141907 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.141880 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99"] Jul 12 21:51:34.161120 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.161096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqvz\" (UniqueName: \"kubernetes.io/projected/5c7cc37d-37b1-463c-b3cf-b7006c40ec5b-kube-api-access-7sqvz\") pod \"limitador-operator-controller-manager-859d7b78bd-r5d99\" (UID: \"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:51:34.262430 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.262392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqvz\" (UniqueName: \"kubernetes.io/projected/5c7cc37d-37b1-463c-b3cf-b7006c40ec5b-kube-api-access-7sqvz\") pod \"limitador-operator-controller-manager-859d7b78bd-r5d99\" (UID: \"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:51:34.272651 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.272626 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqvz\" (UniqueName: \"kubernetes.io/projected/5c7cc37d-37b1-463c-b3cf-b7006c40ec5b-kube-api-access-7sqvz\") pod \"limitador-operator-controller-manager-859d7b78bd-r5d99\" (UID: \"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:51:34.435537 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.435453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:51:34.573293 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:34.573266 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99"] Jul 12 21:51:34.575402 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:34.575375 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7cc37d_37b1_463c_b3cf_b7006c40ec5b.slice/crio-463dac430455a58b1311f06fbcd7dbb04e335dce6fda284f7887d87c922ae4ae WatchSource:0}: Error finding container 463dac430455a58b1311f06fbcd7dbb04e335dce6fda284f7887d87c922ae4ae: Status 404 returned error can't find the container with id 463dac430455a58b1311f06fbcd7dbb04e335dce6fda284f7887d87c922ae4ae Jul 12 21:51:35.134054 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:35.134018 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" event={"ID":"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b","Type":"ContainerStarted","Data":"463dac430455a58b1311f06fbcd7dbb04e335dce6fda284f7887d87c922ae4ae"} Jul 12 21:51:37.146370 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:37.146328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" event={"ID":"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b","Type":"ContainerStarted","Data":"36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4"} Jul 12 21:51:37.146796 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:37.146421 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:51:37.163333 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:37.163280 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" podStartSLOduration=1.4173903239999999 podStartE2EDuration="3.16326615s" totalImagesPullingTime="1.745875826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:51:37.161575451 +0000 UTC m=+436.869032639" watchObservedRunningTime="2026-07-12 21:51:37.16326615 +0000 UTC m=+436.870723314" Jul 12 21:51:39.999707 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:39.999671 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:40.000117 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:39.999727 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:40.005243 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:40.005219 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:40.166140 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:40.166111 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-744df6c7f6-dhzgg" Jul 12 21:51:40.219057 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:40.219018 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85744d95cf-pbvpr"] Jul 12 21:51:44.238858 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.238764 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x"] Jul 12 21:51:44.242149 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.242129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.245428 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.245410 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f289z\"" Jul 12 21:51:44.256168 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.256142 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x"] Jul 12 21:51:44.356002 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.355948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjng9\" (UniqueName: \"kubernetes.io/projected/7254b8af-0eaa-45fb-8b47-3304e72ba584-kube-api-access-hjng9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.356173 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.356083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7254b8af-0eaa-45fb-8b47-3304e72ba584-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.456784 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.456737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7254b8af-0eaa-45fb-8b47-3304e72ba584-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.456944 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.456831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjng9\" (UniqueName: \"kubernetes.io/projected/7254b8af-0eaa-45fb-8b47-3304e72ba584-kube-api-access-hjng9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.457137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.457115 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7254b8af-0eaa-45fb-8b47-3304e72ba584-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.469247 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.469214 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjng9\" (UniqueName: \"kubernetes.io/projected/7254b8af-0eaa-45fb-8b47-3304e72ba584-kube-api-access-hjng9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.552013 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.551902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:44.689866 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:44.689844 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x"] Jul 12 21:51:44.691520 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:51:44.691493 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7254b8af_0eaa_45fb_8b47_3304e72ba584.slice/crio-74568688a7cf51917cb814bbb9dfb46de03c92ecce9bb42bd031576b6be42306 WatchSource:0}: Error finding container 74568688a7cf51917cb814bbb9dfb46de03c92ecce9bb42bd031576b6be42306: Status 404 returned error can't find the container with id 74568688a7cf51917cb814bbb9dfb46de03c92ecce9bb42bd031576b6be42306 Jul 12 21:51:45.189184 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:45.189145 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" event={"ID":"7254b8af-0eaa-45fb-8b47-3304e72ba584","Type":"ContainerStarted","Data":"74568688a7cf51917cb814bbb9dfb46de03c92ecce9bb42bd031576b6be42306"} Jul 12 21:51:48.154115 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:48.154079 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:51:51.227293 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:51.227247 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" event={"ID":"7254b8af-0eaa-45fb-8b47-3304e72ba584","Type":"ContainerStarted","Data":"950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29"} Jul 12 21:51:51.227758 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:51.227338 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:51:51.250292 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:51:51.250238 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" podStartSLOduration=1.738638873 podStartE2EDuration="7.250221294s" totalImagesPullingTime="5.511582421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:51:51.246533304 +0000 UTC m=+450.953990467" watchObservedRunningTime="2026-07-12 21:51:51.250221294 +0000 UTC m=+450.957678460" Jul 12 21:52:02.235912 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:02.235880 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:03.327649 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.327612 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb"] Jul 12 21:52:03.332919 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.332896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:03.343902 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.343875 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb"] Jul 12 21:52:03.434280 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.434242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afbc9072-c8d4-4af2-b400-9ab73a697f16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:03.434280 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.434284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvchg\" (UniqueName: \"kubernetes.io/projected/afbc9072-c8d4-4af2-b400-9ab73a697f16-kube-api-access-jvchg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:03.445785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.445755 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb"] Jul 12 21:52:03.446050 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:03.446029 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-jvchg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" Jul 12 21:52:03.495225 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.495191 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94"] Jul 12 21:52:03.498952 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.498930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.523227 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.523195 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94"] Jul 12 21:52:03.535007 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.534973 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afbc9072-c8d4-4af2-b400-9ab73a697f16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:03.535135 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.535029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvchg\" (UniqueName: \"kubernetes.io/projected/afbc9072-c8d4-4af2-b400-9ab73a697f16-kube-api-access-jvchg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:03.535345 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.535326 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afbc9072-c8d4-4af2-b400-9ab73a697f16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:03.547327 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.547298 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvchg\" (UniqueName: \"kubernetes.io/projected/afbc9072-c8d4-4af2-b400-9ab73a697f16-kube-api-access-jvchg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:03.635530 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.635497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thcst\" (UniqueName: \"kubernetes.io/projected/93e461de-dc0e-4e64-afaf-6dfae4086a49-kube-api-access-thcst\") pod \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.635701 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.635537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93e461de-dc0e-4e64-afaf-6dfae4086a49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.736894 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.736859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thcst\" (UniqueName: \"kubernetes.io/projected/93e461de-dc0e-4e64-afaf-6dfae4086a49-kube-api-access-thcst\") pod \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.736894 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.736899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93e461de-dc0e-4e64-afaf-6dfae4086a49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.737325 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.737307 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93e461de-dc0e-4e64-afaf-6dfae4086a49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.747453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.747422 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thcst\" (UniqueName: \"kubernetes.io/projected/93e461de-dc0e-4e64-afaf-6dfae4086a49-kube-api-access-thcst\") pod \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.808634 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.808597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:03.872302 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.872233 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94"] Jul 12 21:52:03.886712 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.886625 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94"] Jul 12 21:52:03.903224 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.903190 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr"] Jul 12 21:52:03.907915 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.907891 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb"] Jul 12 21:52:03.908056 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.908024 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:03.922501 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.922472 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr"] Jul 12 21:52:03.927286 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.927224 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb"] Jul 12 21:52:03.942260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.942214 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x"] Jul 12 21:52:03.942495 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.942432 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" containerName="manager" containerID="cri-o://950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29" gracePeriod=2 Jul 12 21:52:03.945543 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.945470 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x"] Jul 12 21:52:03.948796 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:03.948761 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:03.958377 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.958343 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99"] Jul 12 21:52:03.958597 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.958572 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" containerName="manager" containerID="cri-o://36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4" gracePeriod=2 Jul 12 21:52:03.970150 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:03.970110 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-r5d99\": pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:03.971786 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.971738 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99"] Jul 12 21:52:03.972822 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:03.972788 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:03.975128 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.975106 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2"] Jul 12 21:52:03.975644 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.975625 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" containerName="manager" Jul 12 21:52:03.975725 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.975646 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" containerName="manager" Jul 12 21:52:03.975725 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.975659 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" containerName="manager" Jul 12 21:52:03.975725 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.975667 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" containerName="manager" Jul 12 21:52:03.975877 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.975781 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" containerName="manager" Jul 12 21:52:03.975877 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.975802 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" containerName="manager" Jul 12 21:52:03.979282 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.979260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:03.981486 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:03.981452 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:03.993038 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:03.991519 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2"] Jul 12 21:52:04.006331 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.006295 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.041051 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.041014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxr4f\" (UniqueName: \"kubernetes.io/projected/6b78e395-ce57-4053-b22b-b20d5c03b64b-kube-api-access-mxr4f\") pod \"kuadrant-operator-controller-manager-55467d9f7-qw8dr\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:04.041231 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.041106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b78e395-ce57-4053-b22b-b20d5c03b64b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qw8dr\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.129241 2573 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9gl94_kuadrant-system_93e461de-dc0e-4e64-afaf-6dfae4086a49_0(6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9gl94 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468" Netns:"/var/run/netns/d39e0ebe-45e1-45d7-a7fc-e2b0409c0544" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-9gl94;K8S_POD_INFRA_CONTAINER_ID=6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468;K8S_POD_UID=93e461de-dc0e-4e64-afaf-6dfae4086a49" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94/93e461de-dc0e-4e64-afaf-6dfae4086a49:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94 6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94 6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2b [10.132.0.43/23] Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: ' Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: > Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.129318 2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9gl94_kuadrant-system_93e461de-dc0e-4e64-afaf-6dfae4086a49_0(6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9gl94 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468" Netns:"/var/run/netns/d39e0ebe-45e1-45d7-a7fc-e2b0409c0544" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-9gl94;K8S_POD_INFRA_CONTAINER_ID=6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468;K8S_POD_UID=93e461de-dc0e-4e64-afaf-6dfae4086a49" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94/93e461de-dc0e-4e64-afaf-6dfae4086a49:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94 6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94 6d4a26ffb52c006f919ca3fc97adbd7e4c46a7d83ecc0523b9c82d4b7a94c468 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2b [10.132.0.43/23] Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: ' Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 12 21:52:04.129323 ip-10-0-128-127 kubenswrapper[2573]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.141774 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.141698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5c48e0a-1858-4f04-8dbd-503c74c10e66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7bhc2\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:04.141774 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.141770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxr4f\" (UniqueName: \"kubernetes.io/projected/6b78e395-ce57-4053-b22b-b20d5c03b64b-kube-api-access-mxr4f\") pod \"kuadrant-operator-controller-manager-55467d9f7-qw8dr\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:04.141947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.141868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b78e395-ce57-4053-b22b-b20d5c03b64b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qw8dr\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:04.141947 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.141928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6sf\" (UniqueName: \"kubernetes.io/projected/d5c48e0a-1858-4f04-8dbd-503c74c10e66-kube-api-access-tt6sf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7bhc2\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:04.142341 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.142312 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b78e395-ce57-4053-b22b-b20d5c03b64b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qw8dr\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:04.153289 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.153259 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxr4f\" (UniqueName: \"kubernetes.io/projected/6b78e395-ce57-4053-b22b-b20d5c03b64b-kube-api-access-mxr4f\") pod \"kuadrant-operator-controller-manager-55467d9f7-qw8dr\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:04.210506 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.210480 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.212788 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.212758 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.213651 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.213631 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.214668 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.214644 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.216607 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.216585 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.218841 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.218819 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.218918 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.218841 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:04.242758 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.242726 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6sf\" (UniqueName: \"kubernetes.io/projected/d5c48e0a-1858-4f04-8dbd-503c74c10e66-kube-api-access-tt6sf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7bhc2\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:04.242902 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.242783 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5c48e0a-1858-4f04-8dbd-503c74c10e66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7bhc2\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:04.243193 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.243175 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5c48e0a-1858-4f04-8dbd-503c74c10e66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7bhc2\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:04.260213 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.260187 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6sf\" (UniqueName: \"kubernetes.io/projected/d5c48e0a-1858-4f04-8dbd-503c74c10e66-kube-api-access-tt6sf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7bhc2\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:04.303231 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.303200 2573 generic.go:356] "Generic (PLEG): container finished" podID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" containerID="36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4" exitCode=0 Jul 12 21:52:04.303368 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.303270 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.303368 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.303364 2573 scope.go:117] "RemoveContainer" containerID="36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4" Jul 12 21:52:04.305454 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.305424 2573 generic.go:356] "Generic (PLEG): container finished" podID="7254b8af-0eaa-45fb-8b47-3304e72ba584" containerID="950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29" exitCode=0 Jul 12 21:52:04.305554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.305477 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.305712 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.305649 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:04.305919 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.305830 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.306034 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.305956 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.307994 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.307952 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.309980 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.309944 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.311920 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.311884 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.313919 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.313890 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.316197 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.316033 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:04.316197 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.316148 2573 scope.go:117] "RemoveContainer" containerID="36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4" Jul 12 21:52:04.316463 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.316428 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4\": container with ID starting with 36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4 not found: ID does not exist" containerID="36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4" Jul 12 21:52:04.316555 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.316464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:04.316555 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.316470 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4"} err="failed to get container status \"36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4\": rpc error: code = NotFound desc = could not find container \"36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4\": container with ID starting with 36eb5a4120c239d0ea6787987272139ecc1fc2d523ae92b5b65b3f8faa7a38e4 not found: ID does not exist" Jul 12 21:52:04.316555 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.316487 2573 scope.go:117] "RemoveContainer" containerID="950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29" Jul 12 21:52:04.318407 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.318381 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.320121 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.320099 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.321205 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.321098 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.321789 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.321759 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:04.323730 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.323698 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.325711 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.325682 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:04.328054 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.327410 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.328476 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.328442 2573 scope.go:117] "RemoveContainer" containerID="950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29" Jul 12 21:52:04.329542 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.329311 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.329542 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.329462 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29\": container with ID starting with 950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29 not found: ID does not exist" containerID="950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29" Jul 12 21:52:04.329542 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.329494 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29"} err="failed to get container status \"950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29\": rpc error: code = NotFound desc = could not find container \"950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29\": container with ID starting with 950b2ae625d1cdb206a69aca0eafb82b18ee9e82bf2f9950b3fe9a40d5d8fb29 not found: ID does not exist" Jul 12 21:52:04.331102 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.331076 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.344032 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.344011 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjng9\" (UniqueName: \"kubernetes.io/projected/7254b8af-0eaa-45fb-8b47-3304e72ba584-kube-api-access-hjng9\") pod \"7254b8af-0eaa-45fb-8b47-3304e72ba584\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " Jul 12 21:52:04.344123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.344068 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sqvz\" (UniqueName: \"kubernetes.io/projected/5c7cc37d-37b1-463c-b3cf-b7006c40ec5b-kube-api-access-7sqvz\") pod \"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b\" (UID: \"5c7cc37d-37b1-463c-b3cf-b7006c40ec5b\") " Jul 12 21:52:04.344123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.344086 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7254b8af-0eaa-45fb-8b47-3304e72ba584-extensions-socket-volume\") pod \"7254b8af-0eaa-45fb-8b47-3304e72ba584\" (UID: \"7254b8af-0eaa-45fb-8b47-3304e72ba584\") " Jul 12 21:52:04.344568 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.344545 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7254b8af-0eaa-45fb-8b47-3304e72ba584-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7254b8af-0eaa-45fb-8b47-3304e72ba584" (UID: "7254b8af-0eaa-45fb-8b47-3304e72ba584"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:52:04.345923 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.345902 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7254b8af-0eaa-45fb-8b47-3304e72ba584-kube-api-access-hjng9" (OuterVolumeSpecName: "kube-api-access-hjng9") pod "7254b8af-0eaa-45fb-8b47-3304e72ba584" (UID: "7254b8af-0eaa-45fb-8b47-3304e72ba584"). InnerVolumeSpecName "kube-api-access-hjng9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:04.346015 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.345955 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7cc37d-37b1-463c-b3cf-b7006c40ec5b-kube-api-access-7sqvz" (OuterVolumeSpecName: "kube-api-access-7sqvz") pod "5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" (UID: "5c7cc37d-37b1-463c-b3cf-b7006c40ec5b"). InnerVolumeSpecName "kube-api-access-7sqvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:04.372452 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.372428 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr"] Jul 12 21:52:04.373216 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:52:04.373192 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b78e395_ce57_4053_b22b_b20d5c03b64b.slice/crio-dfd8ee4ccf8008e666742cfb2e1c3881d4d8bd0385f569683406e32d280540ec WatchSource:0}: Error finding container dfd8ee4ccf8008e666742cfb2e1c3881d4d8bd0385f569683406e32d280540ec: Status 404 returned error can't find the container with id dfd8ee4ccf8008e666742cfb2e1c3881d4d8bd0385f569683406e32d280540ec Jul 12 21:52:04.374349 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.374331 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:04.445396 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.445374 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thcst\" (UniqueName: \"kubernetes.io/projected/93e461de-dc0e-4e64-afaf-6dfae4086a49-kube-api-access-thcst\") pod \"93e461de-dc0e-4e64-afaf-6dfae4086a49\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " Jul 12 21:52:04.445538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.445446 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93e461de-dc0e-4e64-afaf-6dfae4086a49-extensions-socket-volume\") pod \"93e461de-dc0e-4e64-afaf-6dfae4086a49\" (UID: \"93e461de-dc0e-4e64-afaf-6dfae4086a49\") " Jul 12 21:52:04.445538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.445516 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvchg\" (UniqueName: \"kubernetes.io/projected/afbc9072-c8d4-4af2-b400-9ab73a697f16-kube-api-access-jvchg\") pod \"afbc9072-c8d4-4af2-b400-9ab73a697f16\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " Jul 12 21:52:04.445657 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.445550 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afbc9072-c8d4-4af2-b400-9ab73a697f16-extensions-socket-volume\") pod \"afbc9072-c8d4-4af2-b400-9ab73a697f16\" (UID: \"afbc9072-c8d4-4af2-b400-9ab73a697f16\") " Jul 12 21:52:04.445822 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.445803 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sqvz\" (UniqueName: \"kubernetes.io/projected/5c7cc37d-37b1-463c-b3cf-b7006c40ec5b-kube-api-access-7sqvz\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:04.445902 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.445828 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7254b8af-0eaa-45fb-8b47-3304e72ba584-extensions-socket-volume\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:04.445902 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.445843 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjng9\" (UniqueName: \"kubernetes.io/projected/7254b8af-0eaa-45fb-8b47-3304e72ba584-kube-api-access-hjng9\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:04.446067 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.446047 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbc9072-c8d4-4af2-b400-9ab73a697f16-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "afbc9072-c8d4-4af2-b400-9ab73a697f16" (UID: "afbc9072-c8d4-4af2-b400-9ab73a697f16"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:52:04.446116 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.446049 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e461de-dc0e-4e64-afaf-6dfae4086a49-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "93e461de-dc0e-4e64-afaf-6dfae4086a49" (UID: "93e461de-dc0e-4e64-afaf-6dfae4086a49"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:52:04.447822 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.447798 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afbc9072-c8d4-4af2-b400-9ab73a697f16-kube-api-access-jvchg" (OuterVolumeSpecName: "kube-api-access-jvchg") pod "afbc9072-c8d4-4af2-b400-9ab73a697f16" (UID: "afbc9072-c8d4-4af2-b400-9ab73a697f16"). InnerVolumeSpecName "kube-api-access-jvchg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:04.447899 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.447819 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e461de-dc0e-4e64-afaf-6dfae4086a49-kube-api-access-thcst" (OuterVolumeSpecName: "kube-api-access-thcst") pod "93e461de-dc0e-4e64-afaf-6dfae4086a49" (UID: "93e461de-dc0e-4e64-afaf-6dfae4086a49"). InnerVolumeSpecName "kube-api-access-thcst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:04.541727 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.541695 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2"] Jul 12 21:52:04.544152 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:52:04.544124 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c48e0a_1858_4f04_8dbd_503c74c10e66.slice/crio-e14fba85d10ceb1734d9f768438cfdcfd85103d335607657099bde671c9040e6 WatchSource:0}: Error finding container e14fba85d10ceb1734d9f768438cfdcfd85103d335607657099bde671c9040e6: Status 404 returned error can't find the container with id e14fba85d10ceb1734d9f768438cfdcfd85103d335607657099bde671c9040e6 Jul 12 21:52:04.546337 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.546313 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93e461de-dc0e-4e64-afaf-6dfae4086a49-extensions-socket-volume\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:04.546411 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.546342 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvchg\" (UniqueName: \"kubernetes.io/projected/afbc9072-c8d4-4af2-b400-9ab73a697f16-kube-api-access-jvchg\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:04.546411 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.546355 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afbc9072-c8d4-4af2-b400-9ab73a697f16-extensions-socket-volume\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:04.546411 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:04.546366 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thcst\" (UniqueName: \"kubernetes.io/projected/93e461de-dc0e-4e64-afaf-6dfae4086a49-kube-api-access-thcst\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:04.618915 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.618877 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.620829 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.620800 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.624850 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.624822 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.626711 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.626683 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:04.628531 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.628505 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r5d99\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r5d99" Jul 12 21:52:04.630193 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.630159 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9rr4x\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9rr4x" Jul 12 21:52:04.631841 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.631811 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:04.633511 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:04.633480 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:05.001309 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.001273 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7cc37d-37b1-463c-b3cf-b7006c40ec5b" path="/var/lib/kubelet/pods/5c7cc37d-37b1-463c-b3cf-b7006c40ec5b/volumes" Jul 12 21:52:05.001674 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.001659 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7254b8af-0eaa-45fb-8b47-3304e72ba584" path="/var/lib/kubelet/pods/7254b8af-0eaa-45fb-8b47-3304e72ba584/volumes" Jul 12 21:52:05.002045 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.002031 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" path="/var/lib/kubelet/pods/93e461de-dc0e-4e64-afaf-6dfae4086a49/volumes" Jul 12 21:52:05.002285 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.002274 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" path="/var/lib/kubelet/pods/afbc9072-c8d4-4af2-b400-9ab73a697f16/volumes" Jul 12 21:52:05.240184 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.240118 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85744d95cf-pbvpr" podUID="bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" containerName="console" containerID="cri-o://a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153" gracePeriod=15 Jul 12 21:52:05.313031 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.312998 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" event={"ID":"d5c48e0a-1858-4f04-8dbd-503c74c10e66","Type":"ContainerStarted","Data":"bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047"} Jul 12 21:52:05.313227 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.313050 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" event={"ID":"d5c48e0a-1858-4f04-8dbd-503c74c10e66","Type":"ContainerStarted","Data":"e14fba85d10ceb1734d9f768438cfdcfd85103d335607657099bde671c9040e6"} Jul 12 21:52:05.313227 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.313177 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:05.314687 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.314659 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" event={"ID":"6b78e395-ce57-4053-b22b-b20d5c03b64b","Type":"ContainerStarted","Data":"8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7"} Jul 12 21:52:05.314836 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.314714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" event={"ID":"6b78e395-ce57-4053-b22b-b20d5c03b64b","Type":"ContainerStarted","Data":"dfd8ee4ccf8008e666742cfb2e1c3881d4d8bd0385f569683406e32d280540ec"} Jul 12 21:52:05.314836 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.314745 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:05.315598 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.315583 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:05.315693 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.315604 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:05.335988 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.333526 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" podStartSLOduration=2.333505539 podStartE2EDuration="2.333505539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:05.33206752 +0000 UTC m=+465.039524728" watchObservedRunningTime="2026-07-12 21:52:05.333505539 +0000 UTC m=+465.040962704" Jul 12 21:52:05.359532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.359485 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" podStartSLOduration=2.359467326 podStartE2EDuration="2.359467326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:05.357582123 +0000 UTC m=+465.065039353" watchObservedRunningTime="2026-07-12 21:52:05.359467326 +0000 UTC m=+465.066924490" Jul 12 21:52:05.359764 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:05.359728 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:05.361477 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:05.361448 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:05.496852 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.496827 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:52:05.499107 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:05.499079 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:05.501077 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:05.501052 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:05.655923 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.655888 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-trusted-ca-bundle\") pod \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " Jul 12 21:52:05.656137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.655933 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-config\") pod \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " Jul 12 21:52:05.656137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.655982 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-serving-cert\") pod \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " Jul 12 21:52:05.656137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656026 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-service-ca\") pod \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " Jul 12 21:52:05.656137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656047 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlqp2\" (UniqueName: \"kubernetes.io/projected/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-kube-api-access-jlqp2\") pod \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " Jul 12 21:52:05.656137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656079 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-oauth-config\") pod \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " Jul 12 21:52:05.656137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656117 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-oauth-serving-cert\") pod \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\" (UID: \"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d\") " Jul 12 21:52:05.656480 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656348 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" (UID: "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:52:05.656548 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656457 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-config" (OuterVolumeSpecName: "console-config") pod "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" (UID: "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:52:05.656627 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656594 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-service-ca" (OuterVolumeSpecName: "service-ca") pod "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" (UID: "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:52:05.656756 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.656664 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" (UID: "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:52:05.658290 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.658261 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" (UID: "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:52:05.658379 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.658307 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-kube-api-access-jlqp2" (OuterVolumeSpecName: "kube-api-access-jlqp2") pod "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" (UID: "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d"). InnerVolumeSpecName "kube-api-access-jlqp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:05.658379 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.658343 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" (UID: "bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:52:05.756897 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.756862 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-oauth-config\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:05.756897 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.756892 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-oauth-serving-cert\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:05.756897 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.756904 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-trusted-ca-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:05.757159 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.756916 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-config\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:05.757159 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.756928 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-console-serving-cert\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:05.757159 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.756940 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-service-ca\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:05.757159 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:05.756952 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlqp2\" (UniqueName: \"kubernetes.io/projected/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d-kube-api-access-jlqp2\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:06.322982 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.322937 2573 generic.go:356] "Generic (PLEG): container finished" podID="bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" containerID="a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153" exitCode=0 Jul 12 21:52:06.323154 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.323007 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85744d95cf-pbvpr" Jul 12 21:52:06.323154 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.323022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85744d95cf-pbvpr" event={"ID":"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d","Type":"ContainerDied","Data":"a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153"} Jul 12 21:52:06.323154 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.323073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85744d95cf-pbvpr" event={"ID":"bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d","Type":"ContainerDied","Data":"3fab534a9254829096a57480f30afdd58faa61108738ed56236927bb0759d7ee"} Jul 12 21:52:06.323154 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.323096 2573 scope.go:117] "RemoveContainer" containerID="a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153" Jul 12 21:52:06.325834 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:06.325804 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:06.328493 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:06.328465 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:06.332532 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.332514 2573 scope.go:117] "RemoveContainer" containerID="a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153" Jul 12 21:52:06.332822 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:06.332802 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153\": container with ID starting with a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153 not found: ID does not exist" containerID="a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153" Jul 12 21:52:06.332883 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.332832 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153"} err="failed to get container status \"a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153\": rpc error: code = NotFound desc = could not find container \"a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153\": container with ID starting with a091fe9714e34b3be0c1074a16e69d34bf254e3a4192936fc3a51e14fb870153 not found: ID does not exist" Jul 12 21:52:06.354366 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.354339 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85744d95cf-pbvpr"] Jul 12 21:52:06.362195 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:06.362169 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85744d95cf-pbvpr"] Jul 12 21:52:06.362757 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:06.362724 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9gl94\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="93e461de-dc0e-4e64-afaf-6dfae4086a49" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9gl94" Jul 12 21:52:06.364743 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:06.364724 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9hjsb\" is forbidden: User \"system:node:ip-10-0-128-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-127.ec2.internal' and this object" podUID="afbc9072-c8d4-4af2-b400-9ab73a697f16" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9hjsb" Jul 12 21:52:07.000258 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:07.000222 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" path="/var/lib/kubelet/pods/bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d/volumes" Jul 12 21:52:16.325741 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.325708 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:16.326241 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.325793 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:16.389608 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.389574 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2"] Jul 12 21:52:16.389852 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.389820 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" podUID="d5c48e0a-1858-4f04-8dbd-503c74c10e66" containerName="manager" containerID="cri-o://bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047" gracePeriod=10 Jul 12 21:52:16.640376 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.640347 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6"] Jul 12 21:52:16.640708 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.640697 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" containerName="console" Jul 12 21:52:16.640758 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.640709 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" containerName="console" Jul 12 21:52:16.640806 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.640795 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcae5b2c-5d70-42ef-8dc0-b94400cb8e7d" containerName="console" Jul 12 21:52:16.643983 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.643949 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:16.646791 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.646768 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:16.659273 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.659247 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6"] Jul 12 21:52:16.746555 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.746518 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt6sf\" (UniqueName: \"kubernetes.io/projected/d5c48e0a-1858-4f04-8dbd-503c74c10e66-kube-api-access-tt6sf\") pod \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " Jul 12 21:52:16.746740 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.746562 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5c48e0a-1858-4f04-8dbd-503c74c10e66-extensions-socket-volume\") pod \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\" (UID: \"d5c48e0a-1858-4f04-8dbd-503c74c10e66\") " Jul 12 21:52:16.746740 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.746686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkxbz\" (UniqueName: \"kubernetes.io/projected/b2d97215-1871-4b40-a6f8-6809240dae28-kube-api-access-fkxbz\") pod \"kuadrant-operator-controller-manager-86878c769f-gwpc6\" (UID: \"b2d97215-1871-4b40-a6f8-6809240dae28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:16.746843 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.746761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2d97215-1871-4b40-a6f8-6809240dae28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gwpc6\" (UID: \"b2d97215-1871-4b40-a6f8-6809240dae28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:16.747005 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.746953 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c48e0a-1858-4f04-8dbd-503c74c10e66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d5c48e0a-1858-4f04-8dbd-503c74c10e66" (UID: "d5c48e0a-1858-4f04-8dbd-503c74c10e66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:52:16.748637 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.748607 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c48e0a-1858-4f04-8dbd-503c74c10e66-kube-api-access-tt6sf" (OuterVolumeSpecName: "kube-api-access-tt6sf") pod "d5c48e0a-1858-4f04-8dbd-503c74c10e66" (UID: "d5c48e0a-1858-4f04-8dbd-503c74c10e66"). InnerVolumeSpecName "kube-api-access-tt6sf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:16.847835 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.847730 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2d97215-1871-4b40-a6f8-6809240dae28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gwpc6\" (UID: \"b2d97215-1871-4b40-a6f8-6809240dae28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:16.847835 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.847784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkxbz\" (UniqueName: \"kubernetes.io/projected/b2d97215-1871-4b40-a6f8-6809240dae28-kube-api-access-fkxbz\") pod \"kuadrant-operator-controller-manager-86878c769f-gwpc6\" (UID: \"b2d97215-1871-4b40-a6f8-6809240dae28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:16.848137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.847843 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt6sf\" (UniqueName: \"kubernetes.io/projected/d5c48e0a-1858-4f04-8dbd-503c74c10e66-kube-api-access-tt6sf\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:16.848137 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.847855 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5c48e0a-1858-4f04-8dbd-503c74c10e66-extensions-socket-volume\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:16.848259 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.848232 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2d97215-1871-4b40-a6f8-6809240dae28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gwpc6\" (UID: \"b2d97215-1871-4b40-a6f8-6809240dae28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:16.859105 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.859074 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkxbz\" (UniqueName: \"kubernetes.io/projected/b2d97215-1871-4b40-a6f8-6809240dae28-kube-api-access-fkxbz\") pod \"kuadrant-operator-controller-manager-86878c769f-gwpc6\" (UID: \"b2d97215-1871-4b40-a6f8-6809240dae28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:16.954871 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:16.954816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:17.115249 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.115220 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6"] Jul 12 21:52:17.116361 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:52:17.116331 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d97215_1871_4b40_a6f8_6809240dae28.slice/crio-ab8500978562f181d9aefb9535075b3c8db1bbc38693ed4b73da700d82b2eba9 WatchSource:0}: Error finding container ab8500978562f181d9aefb9535075b3c8db1bbc38693ed4b73da700d82b2eba9: Status 404 returned error can't find the container with id ab8500978562f181d9aefb9535075b3c8db1bbc38693ed4b73da700d82b2eba9 Jul 12 21:52:17.388645 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.388559 2573 generic.go:356] "Generic (PLEG): container finished" podID="d5c48e0a-1858-4f04-8dbd-503c74c10e66" containerID="bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047" exitCode=0 Jul 12 21:52:17.388645 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.388623 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" Jul 12 21:52:17.389123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.388643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" event={"ID":"d5c48e0a-1858-4f04-8dbd-503c74c10e66","Type":"ContainerDied","Data":"bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047"} Jul 12 21:52:17.389123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.388703 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2" event={"ID":"d5c48e0a-1858-4f04-8dbd-503c74c10e66","Type":"ContainerDied","Data":"e14fba85d10ceb1734d9f768438cfdcfd85103d335607657099bde671c9040e6"} Jul 12 21:52:17.389123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.388731 2573 scope.go:117] "RemoveContainer" containerID="bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047" Jul 12 21:52:17.390395 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.390369 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" event={"ID":"b2d97215-1871-4b40-a6f8-6809240dae28","Type":"ContainerStarted","Data":"ed00ac16ed4b3c873207a60b2fa93c6fa6206e4e6b69c58b99e6cff21c6fdf6f"} Jul 12 21:52:17.390501 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.390417 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" event={"ID":"b2d97215-1871-4b40-a6f8-6809240dae28","Type":"ContainerStarted","Data":"ab8500978562f181d9aefb9535075b3c8db1bbc38693ed4b73da700d82b2eba9"} Jul 12 21:52:17.390501 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.390453 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:17.398134 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.397864 2573 scope.go:117] "RemoveContainer" containerID="bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047" Jul 12 21:52:17.398201 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:17.398164 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047\": container with ID starting with bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047 not found: ID does not exist" containerID="bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047" Jul 12 21:52:17.398201 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.398192 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047"} err="failed to get container status \"bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047\": rpc error: code = NotFound desc = could not find container \"bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047\": container with ID starting with bb44b57f4fa2df9602bc76b64146d7125ae090f433b25f64768a617389842047 not found: ID does not exist" Jul 12 21:52:17.409042 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.409017 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2"] Jul 12 21:52:17.414741 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.414718 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7bhc2"] Jul 12 21:52:17.434147 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:17.434087 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" podStartSLOduration=1.4340734419999999 podStartE2EDuration="1.434073442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:17.432697853 +0000 UTC m=+477.140155040" watchObservedRunningTime="2026-07-12 21:52:17.434073442 +0000 UTC m=+477.141530606" Jul 12 21:52:19.000355 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:19.000322 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5c48e0a-1858-4f04-8dbd-503c74c10e66" path="/var/lib/kubelet/pods/d5c48e0a-1858-4f04-8dbd-503c74c10e66/volumes" Jul 12 21:52:28.399976 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.399928 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gwpc6" Jul 12 21:52:28.458085 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.458052 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr"] Jul 12 21:52:28.458346 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.458298 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" podUID="6b78e395-ce57-4053-b22b-b20d5c03b64b" containerName="manager" containerID="cri-o://8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7" gracePeriod=10 Jul 12 21:52:28.702015 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.701989 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:28.751031 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.751002 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxr4f\" (UniqueName: \"kubernetes.io/projected/6b78e395-ce57-4053-b22b-b20d5c03b64b-kube-api-access-mxr4f\") pod \"6b78e395-ce57-4053-b22b-b20d5c03b64b\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " Jul 12 21:52:28.751204 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.751053 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b78e395-ce57-4053-b22b-b20d5c03b64b-extensions-socket-volume\") pod \"6b78e395-ce57-4053-b22b-b20d5c03b64b\" (UID: \"6b78e395-ce57-4053-b22b-b20d5c03b64b\") " Jul 12 21:52:28.751444 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.751420 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b78e395-ce57-4053-b22b-b20d5c03b64b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b78e395-ce57-4053-b22b-b20d5c03b64b" (UID: "6b78e395-ce57-4053-b22b-b20d5c03b64b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:52:28.753139 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.753114 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b78e395-ce57-4053-b22b-b20d5c03b64b-kube-api-access-mxr4f" (OuterVolumeSpecName: "kube-api-access-mxr4f") pod "6b78e395-ce57-4053-b22b-b20d5c03b64b" (UID: "6b78e395-ce57-4053-b22b-b20d5c03b64b"). InnerVolumeSpecName "kube-api-access-mxr4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:28.852720 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.852686 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxr4f\" (UniqueName: \"kubernetes.io/projected/6b78e395-ce57-4053-b22b-b20d5c03b64b-kube-api-access-mxr4f\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:28.852720 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:28.852714 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b78e395-ce57-4053-b22b-b20d5c03b64b-extensions-socket-volume\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:29.459127 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.459086 2573 generic.go:356] "Generic (PLEG): container finished" podID="6b78e395-ce57-4053-b22b-b20d5c03b64b" containerID="8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7" exitCode=0 Jul 12 21:52:29.459554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.459138 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" Jul 12 21:52:29.459554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.459154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" event={"ID":"6b78e395-ce57-4053-b22b-b20d5c03b64b","Type":"ContainerDied","Data":"8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7"} Jul 12 21:52:29.459554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.459207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr" event={"ID":"6b78e395-ce57-4053-b22b-b20d5c03b64b","Type":"ContainerDied","Data":"dfd8ee4ccf8008e666742cfb2e1c3881d4d8bd0385f569683406e32d280540ec"} Jul 12 21:52:29.459554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.459237 2573 scope.go:117] "RemoveContainer" containerID="8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7" Jul 12 21:52:29.468129 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.468112 2573 scope.go:117] "RemoveContainer" containerID="8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7" Jul 12 21:52:29.468399 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:29.468370 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7\": container with ID starting with 8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7 not found: ID does not exist" containerID="8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7" Jul 12 21:52:29.468488 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.468402 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7"} err="failed to get container status \"8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7\": rpc error: code = NotFound desc = could not find container \"8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7\": container with ID starting with 8cc8db4aea05c149d7db1879e00dbb3351690618e3bca50573267e8c5ac5aee7 not found: ID does not exist" Jul 12 21:52:29.483856 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.483827 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr"] Jul 12 21:52:29.494079 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:29.494054 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qw8dr"] Jul 12 21:52:31.000005 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:30.999957 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b78e395-ce57-4053-b22b-b20d5c03b64b" path="/var/lib/kubelet/pods/6b78e395-ce57-4053-b22b-b20d5c03b64b/volumes" Jul 12 21:52:32.698336 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.698305 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d"] Jul 12 21:52:32.698708 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.698697 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b78e395-ce57-4053-b22b-b20d5c03b64b" containerName="manager" Jul 12 21:52:32.698747 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.698709 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b78e395-ce57-4053-b22b-b20d5c03b64b" containerName="manager" Jul 12 21:52:32.698747 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.698736 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c48e0a-1858-4f04-8dbd-503c74c10e66" containerName="manager" Jul 12 21:52:32.698747 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.698741 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c48e0a-1858-4f04-8dbd-503c74c10e66" containerName="manager" Jul 12 21:52:32.698856 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.698795 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b78e395-ce57-4053-b22b-b20d5c03b64b" containerName="manager" Jul 12 21:52:32.698856 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.698804 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c48e0a-1858-4f04-8dbd-503c74c10e66" containerName="manager" Jul 12 21:52:32.701237 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.701220 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.704044 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.704019 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pmcsv\"" Jul 12 21:52:32.713467 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.713443 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d"] Jul 12 21:52:32.786609 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb436b7-4e49-4c2b-a983-85f268685160-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb436b7-4e49-4c2b-a983-85f268685160-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786757 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786900 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whsf7\" (UniqueName: \"kubernetes.io/projected/3fb436b7-4e49-4c2b-a983-85f268685160-kube-api-access-whsf7\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786900 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb436b7-4e49-4c2b-a983-85f268685160-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786900 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.786900 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.786889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888019 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.887982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb436b7-4e49-4c2b-a983-85f268685160-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888019 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888220 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb436b7-4e49-4c2b-a983-85f268685160-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888220 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888294 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whsf7\" (UniqueName: \"kubernetes.io/projected/3fb436b7-4e49-4c2b-a983-85f268685160-kube-api-access-whsf7\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888340 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb436b7-4e49-4c2b-a983-85f268685160-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888340 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888443 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888351 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888500 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888479 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888604 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888577 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888751 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888606 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888751 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888705 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.888884 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.888864 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.889127 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.889109 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb436b7-4e49-4c2b-a983-85f268685160-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.890303 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.890282 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb436b7-4e49-4c2b-a983-85f268685160-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.890528 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.890511 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb436b7-4e49-4c2b-a983-85f268685160-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.896416 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.896391 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb436b7-4e49-4c2b-a983-85f268685160-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:32.896546 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:32.896526 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whsf7\" (UniqueName: \"kubernetes.io/projected/3fb436b7-4e49-4c2b-a983-85f268685160-kube-api-access-whsf7\") pod \"maas-default-gateway-openshift-default-56654dcf7-lpp8d\" (UID: \"3fb436b7-4e49-4c2b-a983-85f268685160\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:33.012453 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.012365 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:33.150160 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.150132 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d"] Jul 12 21:52:33.151432 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:52:33.151408 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb436b7_4e49_4c2b_a983_85f268685160.slice/crio-890bb5b1dff6b1f891d1afb1efcb4a52a799909f725c324a1fdbd654bbd0b3e8 WatchSource:0}: Error finding container 890bb5b1dff6b1f891d1afb1efcb4a52a799909f725c324a1fdbd654bbd0b3e8: Status 404 returned error can't find the container with id 890bb5b1dff6b1f891d1afb1efcb4a52a799909f725c324a1fdbd654bbd0b3e8 Jul 12 21:52:33.153483 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.153452 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:52:33.153547 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.153516 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:52:33.153581 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.153544 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:52:33.482002 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.481953 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" event={"ID":"3fb436b7-4e49-4c2b-a983-85f268685160","Type":"ContainerStarted","Data":"b60007176ca753f45a339911c1d682f872f134095fcb85580116ba51b1900c45"} Jul 12 21:52:33.482170 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.482027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" event={"ID":"3fb436b7-4e49-4c2b-a983-85f268685160","Type":"ContainerStarted","Data":"890bb5b1dff6b1f891d1afb1efcb4a52a799909f725c324a1fdbd654bbd0b3e8"} Jul 12 21:52:33.502611 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:33.502561 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" podStartSLOduration=1.5025461 podStartE2EDuration="1.5025461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:33.501236881 +0000 UTC m=+493.208694068" watchObservedRunningTime="2026-07-12 21:52:33.5025461 +0000 UTC m=+493.210003260" Jul 12 21:52:34.013226 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:34.013186 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:34.018067 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:34.018036 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:34.487680 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:34.487650 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:34.488692 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:34.488670 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:52:47.631084 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.631048 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7brb"] Jul 12 21:52:47.634528 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.634510 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:47.637023 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.637000 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j4wpg\"" Jul 12 21:52:47.637133 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.637024 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 12 21:52:47.642409 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.642385 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7brb"] Jul 12 21:52:47.722198 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.722159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqpc2\" (UniqueName: \"kubernetes.io/projected/33517d09-835b-4968-90e3-600e520a0bc4-kube-api-access-gqpc2\") pod \"limitador-limitador-64c94fd64f-l7brb\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:47.722376 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.722262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33517d09-835b-4968-90e3-600e520a0bc4-config-file\") pod \"limitador-limitador-64c94fd64f-l7brb\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:47.729842 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.729811 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7brb"] Jul 12 21:52:47.823296 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.823257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqpc2\" (UniqueName: \"kubernetes.io/projected/33517d09-835b-4968-90e3-600e520a0bc4-kube-api-access-gqpc2\") pod \"limitador-limitador-64c94fd64f-l7brb\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:47.823460 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.823330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33517d09-835b-4968-90e3-600e520a0bc4-config-file\") pod \"limitador-limitador-64c94fd64f-l7brb\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:47.823951 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.823926 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33517d09-835b-4968-90e3-600e520a0bc4-config-file\") pod \"limitador-limitador-64c94fd64f-l7brb\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:47.834174 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.834138 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqpc2\" (UniqueName: \"kubernetes.io/projected/33517d09-835b-4968-90e3-600e520a0bc4-kube-api-access-gqpc2\") pod \"limitador-limitador-64c94fd64f-l7brb\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:47.946919 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:47.946821 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:48.078585 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.078558 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7brb"] Jul 12 21:52:48.080706 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:52:48.080677 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33517d09_835b_4968_90e3_600e520a0bc4.slice/crio-c947363ba0168cbf81f50425c8b56be4fea1b80774f25b1fde686aca16352096 WatchSource:0}: Error finding container c947363ba0168cbf81f50425c8b56be4fea1b80774f25b1fde686aca16352096: Status 404 returned error can't find the container with id c947363ba0168cbf81f50425c8b56be4fea1b80774f25b1fde686aca16352096 Jul 12 21:52:48.474426 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.474393 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rjxjs"] Jul 12 21:52:48.479097 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.479075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjxjs" Jul 12 21:52:48.482268 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.482244 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pvzlm\"" Jul 12 21:52:48.485240 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.485215 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjxjs"] Jul 12 21:52:48.563873 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.563843 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" event={"ID":"33517d09-835b-4968-90e3-600e520a0bc4","Type":"ContainerStarted","Data":"c947363ba0168cbf81f50425c8b56be4fea1b80774f25b1fde686aca16352096"} Jul 12 21:52:48.630390 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.630355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwzmr\" (UniqueName: \"kubernetes.io/projected/10104cfa-5a2b-4d07-b047-dd23ae63de75-kube-api-access-dwzmr\") pod \"authorino-58cd955675-rjxjs\" (UID: \"10104cfa-5a2b-4d07-b047-dd23ae63de75\") " pod="kuadrant-system/authorino-58cd955675-rjxjs" Jul 12 21:52:48.706999 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.704504 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7pcg9"] Jul 12 21:52:48.709857 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.709825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7pcg9" Jul 12 21:52:48.712993 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.712944 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7pcg9"] Jul 12 21:52:48.731419 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.731346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwzmr\" (UniqueName: \"kubernetes.io/projected/10104cfa-5a2b-4d07-b047-dd23ae63de75-kube-api-access-dwzmr\") pod \"authorino-58cd955675-rjxjs\" (UID: \"10104cfa-5a2b-4d07-b047-dd23ae63de75\") " pod="kuadrant-system/authorino-58cd955675-rjxjs" Jul 12 21:52:48.740803 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.740776 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwzmr\" (UniqueName: \"kubernetes.io/projected/10104cfa-5a2b-4d07-b047-dd23ae63de75-kube-api-access-dwzmr\") pod \"authorino-58cd955675-rjxjs\" (UID: \"10104cfa-5a2b-4d07-b047-dd23ae63de75\") " pod="kuadrant-system/authorino-58cd955675-rjxjs" Jul 12 21:52:48.789612 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.789577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjxjs" Jul 12 21:52:48.832733 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.832612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbsqj\" (UniqueName: \"kubernetes.io/projected/274a7fb0-af70-4d60-9190-c85db708060b-kube-api-access-rbsqj\") pod \"authorino-75d556bd77-7pcg9\" (UID: \"274a7fb0-af70-4d60-9190-c85db708060b\") " pod="kuadrant-system/authorino-75d556bd77-7pcg9" Jul 12 21:52:48.933424 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.933384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbsqj\" (UniqueName: \"kubernetes.io/projected/274a7fb0-af70-4d60-9190-c85db708060b-kube-api-access-rbsqj\") pod \"authorino-75d556bd77-7pcg9\" (UID: \"274a7fb0-af70-4d60-9190-c85db708060b\") " pod="kuadrant-system/authorino-75d556bd77-7pcg9" Jul 12 21:52:48.943087 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.943050 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbsqj\" (UniqueName: \"kubernetes.io/projected/274a7fb0-af70-4d60-9190-c85db708060b-kube-api-access-rbsqj\") pod \"authorino-75d556bd77-7pcg9\" (UID: \"274a7fb0-af70-4d60-9190-c85db708060b\") " pod="kuadrant-system/authorino-75d556bd77-7pcg9" Jul 12 21:52:48.976257 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:48.976227 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjxjs"] Jul 12 21:52:48.978497 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:52:48.978465 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10104cfa_5a2b_4d07_b047_dd23ae63de75.slice/crio-9f4634a1ff87f7c85c81a8f37c8d42821a4e052358ca4e4df461da4d192cffd3 WatchSource:0}: Error finding container 9f4634a1ff87f7c85c81a8f37c8d42821a4e052358ca4e4df461da4d192cffd3: Status 404 returned error can't find the container with id 9f4634a1ff87f7c85c81a8f37c8d42821a4e052358ca4e4df461da4d192cffd3 Jul 12 21:52:49.023407 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:49.023143 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7pcg9" Jul 12 21:52:49.194920 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:49.194893 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7pcg9"] Jul 12 21:52:49.196627 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:52:49.196594 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod274a7fb0_af70_4d60_9190_c85db708060b.slice/crio-68474e8dfcc81573a2498dddec59632216370022df87eb451e537ec877d11c93 WatchSource:0}: Error finding container 68474e8dfcc81573a2498dddec59632216370022df87eb451e537ec877d11c93: Status 404 returned error can't find the container with id 68474e8dfcc81573a2498dddec59632216370022df87eb451e537ec877d11c93 Jul 12 21:52:49.571387 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:49.571348 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjxjs" event={"ID":"10104cfa-5a2b-4d07-b047-dd23ae63de75","Type":"ContainerStarted","Data":"9f4634a1ff87f7c85c81a8f37c8d42821a4e052358ca4e4df461da4d192cffd3"} Jul 12 21:52:49.572597 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:49.572568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7pcg9" event={"ID":"274a7fb0-af70-4d60-9190-c85db708060b","Type":"ContainerStarted","Data":"68474e8dfcc81573a2498dddec59632216370022df87eb451e537ec877d11c93"} Jul 12 21:52:53.607872 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.607827 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" event={"ID":"33517d09-835b-4968-90e3-600e520a0bc4","Type":"ContainerStarted","Data":"80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707"} Jul 12 21:52:53.608383 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.607933 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:52:53.609470 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.609446 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjxjs" event={"ID":"10104cfa-5a2b-4d07-b047-dd23ae63de75","Type":"ContainerStarted","Data":"04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28"} Jul 12 21:52:53.610851 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.610821 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7pcg9" event={"ID":"274a7fb0-af70-4d60-9190-c85db708060b","Type":"ContainerStarted","Data":"6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee"} Jul 12 21:52:53.624653 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.624609 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" podStartSLOduration=1.904734573 podStartE2EDuration="6.624596733s" totalImagesPullingTime="4.71986216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:53.622754502 +0000 UTC m=+513.330211695" watchObservedRunningTime="2026-07-12 21:52:53.624596733 +0000 UTC m=+513.332053918" Jul 12 21:52:53.637881 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.637839 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7pcg9" podStartSLOduration=2.02825819 podStartE2EDuration="5.637827229s" totalImagesPullingTime="3.609569039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:53.636049776 +0000 UTC m=+513.343506957" watchObservedRunningTime="2026-07-12 21:52:53.637827229 +0000 UTC m=+513.345284419" Jul 12 21:52:53.652567 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.652520 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rjxjs" podStartSLOduration=1.879853866 podStartE2EDuration="5.652508346s" totalImagesPullingTime="3.77265448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:53.650131174 +0000 UTC m=+513.357588339" watchObservedRunningTime="2026-07-12 21:52:53.652508346 +0000 UTC m=+513.359965543" Jul 12 21:52:53.664949 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:53.664920 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjxjs"] Jul 12 21:52:55.621424 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:55.621381 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rjxjs" podUID="10104cfa-5a2b-4d07-b047-dd23ae63de75" containerName="authorino" containerID="cri-o://04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28" gracePeriod=30 Jul 12 21:52:55.870860 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:55.870831 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjxjs" Jul 12 21:52:56.001777 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.001673 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwzmr\" (UniqueName: \"kubernetes.io/projected/10104cfa-5a2b-4d07-b047-dd23ae63de75-kube-api-access-dwzmr\") pod \"10104cfa-5a2b-4d07-b047-dd23ae63de75\" (UID: \"10104cfa-5a2b-4d07-b047-dd23ae63de75\") " Jul 12 21:52:56.003694 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.003664 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10104cfa-5a2b-4d07-b047-dd23ae63de75-kube-api-access-dwzmr" (OuterVolumeSpecName: "kube-api-access-dwzmr") pod "10104cfa-5a2b-4d07-b047-dd23ae63de75" (UID: "10104cfa-5a2b-4d07-b047-dd23ae63de75"). InnerVolumeSpecName "kube-api-access-dwzmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:52:56.102951 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.102925 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwzmr\" (UniqueName: \"kubernetes.io/projected/10104cfa-5a2b-4d07-b047-dd23ae63de75-kube-api-access-dwzmr\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:52:56.630350 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.630312 2573 generic.go:356] "Generic (PLEG): container finished" podID="10104cfa-5a2b-4d07-b047-dd23ae63de75" containerID="04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28" exitCode=0 Jul 12 21:52:56.630823 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.630358 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjxjs" Jul 12 21:52:56.630823 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.630377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjxjs" event={"ID":"10104cfa-5a2b-4d07-b047-dd23ae63de75","Type":"ContainerDied","Data":"04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28"} Jul 12 21:52:56.630823 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.630417 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjxjs" event={"ID":"10104cfa-5a2b-4d07-b047-dd23ae63de75","Type":"ContainerDied","Data":"9f4634a1ff87f7c85c81a8f37c8d42821a4e052358ca4e4df461da4d192cffd3"} Jul 12 21:52:56.630823 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.630440 2573 scope.go:117] "RemoveContainer" containerID="04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28" Jul 12 21:52:56.638930 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.638910 2573 scope.go:117] "RemoveContainer" containerID="04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28" Jul 12 21:52:56.639203 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:52:56.639186 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28\": container with ID starting with 04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28 not found: ID does not exist" containerID="04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28" Jul 12 21:52:56.639268 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.639211 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28"} err="failed to get container status \"04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28\": rpc error: code = NotFound desc = could not find container \"04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28\": container with ID starting with 04638af786e509d9f9ddad8bcc3be4283f9cbc8b3ca7f3fc0dd61cc821bc2e28 not found: ID does not exist" Jul 12 21:52:56.651036 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.651015 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjxjs"] Jul 12 21:52:56.654823 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:56.654802 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjxjs"] Jul 12 21:52:57.000463 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:52:57.000380 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10104cfa-5a2b-4d07-b047-dd23ae63de75" path="/var/lib/kubelet/pods/10104cfa-5a2b-4d07-b047-dd23ae63de75/volumes" Jul 12 21:53:02.587055 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:02.587018 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7brb"] Jul 12 21:53:02.587514 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:02.587234 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" podUID="33517d09-835b-4968-90e3-600e520a0bc4" containerName="limitador" containerID="cri-o://80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707" gracePeriod=30 Jul 12 21:53:02.587946 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:02.587875 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:53:03.139086 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.139058 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:53:03.166332 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.166257 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqpc2\" (UniqueName: \"kubernetes.io/projected/33517d09-835b-4968-90e3-600e520a0bc4-kube-api-access-gqpc2\") pod \"33517d09-835b-4968-90e3-600e520a0bc4\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " Jul 12 21:53:03.166492 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.166361 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33517d09-835b-4968-90e3-600e520a0bc4-config-file\") pod \"33517d09-835b-4968-90e3-600e520a0bc4\" (UID: \"33517d09-835b-4968-90e3-600e520a0bc4\") " Jul 12 21:53:03.166688 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.166665 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33517d09-835b-4968-90e3-600e520a0bc4-config-file" (OuterVolumeSpecName: "config-file") pod "33517d09-835b-4968-90e3-600e520a0bc4" (UID: "33517d09-835b-4968-90e3-600e520a0bc4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:53:03.168398 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.168374 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33517d09-835b-4968-90e3-600e520a0bc4-kube-api-access-gqpc2" (OuterVolumeSpecName: "kube-api-access-gqpc2") pod "33517d09-835b-4968-90e3-600e520a0bc4" (UID: "33517d09-835b-4968-90e3-600e520a0bc4"). InnerVolumeSpecName "kube-api-access-gqpc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:53:03.267656 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.267624 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqpc2\" (UniqueName: \"kubernetes.io/projected/33517d09-835b-4968-90e3-600e520a0bc4-kube-api-access-gqpc2\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:53:03.267656 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.267651 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33517d09-835b-4968-90e3-600e520a0bc4-config-file\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:53:03.671369 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.671336 2573 generic.go:356] "Generic (PLEG): container finished" podID="33517d09-835b-4968-90e3-600e520a0bc4" containerID="80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707" exitCode=0 Jul 12 21:53:03.671785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.671383 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" Jul 12 21:53:03.671785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.671405 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" event={"ID":"33517d09-835b-4968-90e3-600e520a0bc4","Type":"ContainerDied","Data":"80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707"} Jul 12 21:53:03.671785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.671454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7brb" event={"ID":"33517d09-835b-4968-90e3-600e520a0bc4","Type":"ContainerDied","Data":"c947363ba0168cbf81f50425c8b56be4fea1b80774f25b1fde686aca16352096"} Jul 12 21:53:03.671785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.671484 2573 scope.go:117] "RemoveContainer" containerID="80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707" Jul 12 21:53:03.686816 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.686793 2573 scope.go:117] "RemoveContainer" containerID="80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707" Jul 12 21:53:03.687146 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:53:03.687115 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707\": container with ID starting with 80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707 not found: ID does not exist" containerID="80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707" Jul 12 21:53:03.687238 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.687152 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707"} err="failed to get container status \"80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707\": rpc error: code = NotFound desc = could not find container \"80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707\": container with ID starting with 80be25eab386e76491d34cf7f96312c6dc463e3465b02f5e6f523d5882a9d707 not found: ID does not exist" Jul 12 21:53:03.700288 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.700264 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7brb"] Jul 12 21:53:03.705749 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:03.705728 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7brb"] Jul 12 21:53:05.000641 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:05.000609 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33517d09-835b-4968-90e3-600e520a0bc4" path="/var/lib/kubelet/pods/33517d09-835b-4968-90e3-600e520a0bc4/volumes" Jul 12 21:53:06.285240 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.285207 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-np7qm"] Jul 12 21:53:06.285789 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.285735 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10104cfa-5a2b-4d07-b047-dd23ae63de75" containerName="authorino" Jul 12 21:53:06.285789 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.285756 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="10104cfa-5a2b-4d07-b047-dd23ae63de75" containerName="authorino" Jul 12 21:53:06.285789 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.285773 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33517d09-835b-4968-90e3-600e520a0bc4" containerName="limitador" Jul 12 21:53:06.285789 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.285782 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="33517d09-835b-4968-90e3-600e520a0bc4" containerName="limitador" Jul 12 21:53:06.286050 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.285897 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="10104cfa-5a2b-4d07-b047-dd23ae63de75" containerName="authorino" Jul 12 21:53:06.286050 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.285913 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="33517d09-835b-4968-90e3-600e520a0bc4" containerName="limitador" Jul 12 21:53:06.292637 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.292612 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.295010 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.294976 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-np7qm"] Jul 12 21:53:06.295153 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.295035 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 12 21:53:06.295153 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.295054 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9d9b8\"" Jul 12 21:53:06.395215 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.395180 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/79fd9645-6937-41cf-85ec-09630a2cfcb9-data\") pod \"postgres-69fb4594cf-np7qm\" (UID: \"79fd9645-6937-41cf-85ec-09630a2cfcb9\") " pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.395377 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.395295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfhg\" (UniqueName: \"kubernetes.io/projected/79fd9645-6937-41cf-85ec-09630a2cfcb9-kube-api-access-rnfhg\") pod \"postgres-69fb4594cf-np7qm\" (UID: \"79fd9645-6937-41cf-85ec-09630a2cfcb9\") " pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.496282 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.496246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfhg\" (UniqueName: \"kubernetes.io/projected/79fd9645-6937-41cf-85ec-09630a2cfcb9-kube-api-access-rnfhg\") pod \"postgres-69fb4594cf-np7qm\" (UID: \"79fd9645-6937-41cf-85ec-09630a2cfcb9\") " pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.496451 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.496330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/79fd9645-6937-41cf-85ec-09630a2cfcb9-data\") pod \"postgres-69fb4594cf-np7qm\" (UID: \"79fd9645-6937-41cf-85ec-09630a2cfcb9\") " pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.496707 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.496689 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/79fd9645-6937-41cf-85ec-09630a2cfcb9-data\") pod \"postgres-69fb4594cf-np7qm\" (UID: \"79fd9645-6937-41cf-85ec-09630a2cfcb9\") " pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.504606 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.504580 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfhg\" (UniqueName: \"kubernetes.io/projected/79fd9645-6937-41cf-85ec-09630a2cfcb9-kube-api-access-rnfhg\") pod \"postgres-69fb4594cf-np7qm\" (UID: \"79fd9645-6937-41cf-85ec-09630a2cfcb9\") " pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.603589 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.603566 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:06.734817 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:06.734793 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-np7qm"] Jul 12 21:53:06.736393 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:53:06.736360 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fd9645_6937_41cf_85ec_09630a2cfcb9.slice/crio-1a520427d9309621b9dc7e883cbadae733d0bf309ff8c8182d2cb5313c6332ed WatchSource:0}: Error finding container 1a520427d9309621b9dc7e883cbadae733d0bf309ff8c8182d2cb5313c6332ed: Status 404 returned error can't find the container with id 1a520427d9309621b9dc7e883cbadae733d0bf309ff8c8182d2cb5313c6332ed Jul 12 21:53:07.702117 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:07.702071 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-np7qm" event={"ID":"79fd9645-6937-41cf-85ec-09630a2cfcb9","Type":"ContainerStarted","Data":"1a520427d9309621b9dc7e883cbadae733d0bf309ff8c8182d2cb5313c6332ed"} Jul 12 21:53:12.736837 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:12.736797 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-np7qm" event={"ID":"79fd9645-6937-41cf-85ec-09630a2cfcb9","Type":"ContainerStarted","Data":"ea76e7a6422a7b940450b91f9bf784f58e409bbd5602c0f20bd1832d75ff694a"} Jul 12 21:53:12.737256 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:12.736871 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:12.754955 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:12.754906 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-np7qm" podStartSLOduration=1.340987155 podStartE2EDuration="6.754890199s" totalImagesPullingTime="5.413903044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:12.752293505 +0000 UTC m=+532.459750718" watchObservedRunningTime="2026-07-12 21:53:12.754890199 +0000 UTC m=+532.462347364" Jul 12 21:53:18.772308 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:18.772279 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-np7qm" Jul 12 21:53:20.473650 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.473608 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d"] Jul 12 21:53:20.477350 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.477332 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.480020 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.480001 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 21:53:20.480889 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.480871 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 21:53:20.480988 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.480956 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dv6hl\"" Jul 12 21:53:20.487747 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.487722 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d"] Jul 12 21:53:20.525972 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.525943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-bundle\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.526123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.526007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-util\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.526123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.526057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8fn\" (UniqueName: \"kubernetes.io/projected/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-kube-api-access-cg8fn\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.627349 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.627323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-bundle\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.627498 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.627355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-util\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.627498 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.627381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8fn\" (UniqueName: \"kubernetes.io/projected/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-kube-api-access-cg8fn\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.627693 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.627675 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-bundle\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.627744 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.627705 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-util\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.636065 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.636045 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8fn\" (UniqueName: \"kubernetes.io/projected/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-kube-api-access-cg8fn\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.787071 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.786985 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:20.945618 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:20.945591 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d"] Jul 12 21:53:20.946940 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:53:20.946908 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf8f5a3_f941_440f_95ed_ba9252f25ed5.slice/crio-8b1728d1523f39e1443309be5d33ea452a670317d54b918e4d4dfb000561dace WatchSource:0}: Error finding container 8b1728d1523f39e1443309be5d33ea452a670317d54b918e4d4dfb000561dace: Status 404 returned error can't find the container with id 8b1728d1523f39e1443309be5d33ea452a670317d54b918e4d4dfb000561dace Jul 12 21:53:21.796932 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:21.796903 2573 generic.go:356] "Generic (PLEG): container finished" podID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerID="4aae7d7cca1006575105a58912460e2705d463c70d038b71d79dc2da8cc0deba" exitCode=0 Jul 12 21:53:21.797346 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:21.796991 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" event={"ID":"3bf8f5a3-f941-440f-95ed-ba9252f25ed5","Type":"ContainerDied","Data":"4aae7d7cca1006575105a58912460e2705d463c70d038b71d79dc2da8cc0deba"} Jul 12 21:53:21.797346 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:21.797043 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" event={"ID":"3bf8f5a3-f941-440f-95ed-ba9252f25ed5","Type":"ContainerStarted","Data":"8b1728d1523f39e1443309be5d33ea452a670317d54b918e4d4dfb000561dace"} Jul 12 21:53:22.804521 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:22.804433 2573 generic.go:356] "Generic (PLEG): container finished" podID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerID="2a6f96d58a4a119d7abf0adbc7ec67ef2d6543cde7843f1bb06e9c1280c20892" exitCode=0 Jul 12 21:53:22.804891 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:22.804524 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" event={"ID":"3bf8f5a3-f941-440f-95ed-ba9252f25ed5","Type":"ContainerDied","Data":"2a6f96d58a4a119d7abf0adbc7ec67ef2d6543cde7843f1bb06e9c1280c20892"} Jul 12 21:53:23.811430 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:23.811399 2573 generic.go:356] "Generic (PLEG): container finished" podID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerID="f4ae3aed426c27c7116884255ff0f0e739becf2d4a9946d889a790ba10f13cbb" exitCode=0 Jul 12 21:53:23.811816 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:23.811462 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" event={"ID":"3bf8f5a3-f941-440f-95ed-ba9252f25ed5","Type":"ContainerDied","Data":"f4ae3aed426c27c7116884255ff0f0e739becf2d4a9946d889a790ba10f13cbb"} Jul 12 21:53:24.953060 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:24.953034 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:25.067921 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.067837 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-util\") pod \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " Jul 12 21:53:25.067921 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.067907 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-bundle\") pod \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " Jul 12 21:53:25.068179 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.067947 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg8fn\" (UniqueName: \"kubernetes.io/projected/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-kube-api-access-cg8fn\") pod \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\" (UID: \"3bf8f5a3-f941-440f-95ed-ba9252f25ed5\") " Jul 12 21:53:25.068498 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.068460 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-bundle" (OuterVolumeSpecName: "bundle") pod "3bf8f5a3-f941-440f-95ed-ba9252f25ed5" (UID: "3bf8f5a3-f941-440f-95ed-ba9252f25ed5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:53:25.070190 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.070162 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-kube-api-access-cg8fn" (OuterVolumeSpecName: "kube-api-access-cg8fn") pod "3bf8f5a3-f941-440f-95ed-ba9252f25ed5" (UID: "3bf8f5a3-f941-440f-95ed-ba9252f25ed5"). InnerVolumeSpecName "kube-api-access-cg8fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:53:25.073284 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.073262 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-util" (OuterVolumeSpecName: "util") pod "3bf8f5a3-f941-440f-95ed-ba9252f25ed5" (UID: "3bf8f5a3-f941-440f-95ed-ba9252f25ed5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 21:53:25.168925 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.168891 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-util\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:53:25.168925 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.168919 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-bundle\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:53:25.168925 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.168931 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg8fn\" (UniqueName: \"kubernetes.io/projected/3bf8f5a3-f941-440f-95ed-ba9252f25ed5-kube-api-access-cg8fn\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:53:25.823280 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.823246 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" Jul 12 21:53:25.823459 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.823277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc2tgv5d" event={"ID":"3bf8f5a3-f941-440f-95ed-ba9252f25ed5","Type":"ContainerDied","Data":"8b1728d1523f39e1443309be5d33ea452a670317d54b918e4d4dfb000561dace"} Jul 12 21:53:25.823459 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:25.823329 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b1728d1523f39e1443309be5d33ea452a670317d54b918e4d4dfb000561dace" Jul 12 21:53:28.132855 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.132814 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-5c644dc57d-47wc2"] Jul 12 21:53:28.133342 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.133323 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerName="util" Jul 12 21:53:28.133391 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.133344 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerName="util" Jul 12 21:53:28.133391 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.133356 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerName="pull" Jul 12 21:53:28.133391 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.133361 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerName="pull" Jul 12 21:53:28.133391 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.133380 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerName="extract" Jul 12 21:53:28.133391 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.133387 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerName="extract" Jul 12 21:53:28.133554 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.133454 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf8f5a3-f941-440f-95ed-ba9252f25ed5" containerName="extract" Jul 12 21:53:28.136684 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.136666 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" Jul 12 21:53:28.139083 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.139056 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 12 21:53:28.139219 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.139095 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-vvl6k\"" Jul 12 21:53:28.139219 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.139096 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 12 21:53:28.146403 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.146377 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c644dc57d-47wc2"] Jul 12 21:53:28.298138 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.298099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5xd\" (UniqueName: \"kubernetes.io/projected/100876b0-18d9-41f9-beaf-399d987a25ec-kube-api-access-4t5xd\") pod \"keycloak-operator-5c644dc57d-47wc2\" (UID: \"100876b0-18d9-41f9-beaf-399d987a25ec\") " pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" Jul 12 21:53:28.398643 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.398539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5xd\" (UniqueName: \"kubernetes.io/projected/100876b0-18d9-41f9-beaf-399d987a25ec-kube-api-access-4t5xd\") pod \"keycloak-operator-5c644dc57d-47wc2\" (UID: \"100876b0-18d9-41f9-beaf-399d987a25ec\") " pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" Jul 12 21:53:28.407144 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.407112 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5xd\" (UniqueName: \"kubernetes.io/projected/100876b0-18d9-41f9-beaf-399d987a25ec-kube-api-access-4t5xd\") pod \"keycloak-operator-5c644dc57d-47wc2\" (UID: \"100876b0-18d9-41f9-beaf-399d987a25ec\") " pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" Jul 12 21:53:28.449066 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.449034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" Jul 12 21:53:28.579097 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.579068 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c644dc57d-47wc2"] Jul 12 21:53:28.580226 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:53:28.580195 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100876b0_18d9_41f9_beaf_399d987a25ec.slice/crio-8470d002903a84ae93c4b58662d6cfce87c8b955da9247ee10bf3a362388fba2 WatchSource:0}: Error finding container 8470d002903a84ae93c4b58662d6cfce87c8b955da9247ee10bf3a362388fba2: Status 404 returned error can't find the container with id 8470d002903a84ae93c4b58662d6cfce87c8b955da9247ee10bf3a362388fba2 Jul 12 21:53:28.840214 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:28.840183 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" event={"ID":"100876b0-18d9-41f9-beaf-399d987a25ec","Type":"ContainerStarted","Data":"8470d002903a84ae93c4b58662d6cfce87c8b955da9247ee10bf3a362388fba2"} Jul 12 21:53:34.882349 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:34.882306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" event={"ID":"100876b0-18d9-41f9-beaf-399d987a25ec","Type":"ContainerStarted","Data":"d24e0882928be70c462148a63b5704ede5c72890e50e13f0b9658fa7336d4911"} Jul 12 21:53:34.900620 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:53:34.900575 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-5c644dc57d-47wc2" podStartSLOduration=1.37352667 podStartE2EDuration="6.900560249s" totalImagesPullingTime="5.527033579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:34.899830751 +0000 UTC m=+554.607287935" watchObservedRunningTime="2026-07-12 21:53:34.900560249 +0000 UTC m=+554.608017412" Jul 12 21:54:14.101107 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.101072 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xzdnz"] Jul 12 21:54:14.112329 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.112302 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xzdnz"] Jul 12 21:54:14.112513 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.112410 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xzdnz" Jul 12 21:54:14.217148 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.217110 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9p8j\" (UniqueName: \"kubernetes.io/projected/557dd193-c856-4201-a692-e399250ddc8f-kube-api-access-w9p8j\") pod \"authorino-5d4b67c446-xzdnz\" (UID: \"557dd193-c856-4201-a692-e399250ddc8f\") " pod="kuadrant-system/authorino-5d4b67c446-xzdnz" Jul 12 21:54:14.317926 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.317892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9p8j\" (UniqueName: \"kubernetes.io/projected/557dd193-c856-4201-a692-e399250ddc8f-kube-api-access-w9p8j\") pod \"authorino-5d4b67c446-xzdnz\" (UID: \"557dd193-c856-4201-a692-e399250ddc8f\") " pod="kuadrant-system/authorino-5d4b67c446-xzdnz" Jul 12 21:54:14.327953 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.327924 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xzdnz"] Jul 12 21:54:14.328228 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:54:14.328209 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-w9p8j], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-xzdnz" podUID="557dd193-c856-4201-a692-e399250ddc8f" Jul 12 21:54:14.329035 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.329017 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9p8j\" (UniqueName: \"kubernetes.io/projected/557dd193-c856-4201-a692-e399250ddc8f-kube-api-access-w9p8j\") pod \"authorino-5d4b67c446-xzdnz\" (UID: \"557dd193-c856-4201-a692-e399250ddc8f\") " pod="kuadrant-system/authorino-5d4b67c446-xzdnz" Jul 12 21:54:14.361232 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.361160 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85c7bdb54-6hz66"] Jul 12 21:54:14.363443 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.363422 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c7bdb54-6hz66" Jul 12 21:54:14.374771 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.374750 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85c7bdb54-6hz66"] Jul 12 21:54:14.519417 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.519378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvd5\" (UniqueName: \"kubernetes.io/projected/57795f7f-bb46-4703-a9be-be4cff367c87-kube-api-access-zdvd5\") pod \"authorino-85c7bdb54-6hz66\" (UID: \"57795f7f-bb46-4703-a9be-be4cff367c87\") " pod="kuadrant-system/authorino-85c7bdb54-6hz66" Jul 12 21:54:14.544821 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.544786 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85c7bdb54-6hz66"] Jul 12 21:54:14.545096 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:54:14.545071 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zdvd5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-85c7bdb54-6hz66" podUID="57795f7f-bb46-4703-a9be-be4cff367c87" Jul 12 21:54:14.567078 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.567050 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-865947c99d-6pksx"] Jul 12 21:54:14.569318 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.569303 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:14.571564 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.571543 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 12 21:54:14.579179 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.579158 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-865947c99d-6pksx"] Jul 12 21:54:14.620100 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.620015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvd5\" (UniqueName: \"kubernetes.io/projected/57795f7f-bb46-4703-a9be-be4cff367c87-kube-api-access-zdvd5\") pod \"authorino-85c7bdb54-6hz66\" (UID: \"57795f7f-bb46-4703-a9be-be4cff367c87\") " pod="kuadrant-system/authorino-85c7bdb54-6hz66" Jul 12 21:54:14.628521 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.628493 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvd5\" (UniqueName: \"kubernetes.io/projected/57795f7f-bb46-4703-a9be-be4cff367c87-kube-api-access-zdvd5\") pod \"authorino-85c7bdb54-6hz66\" (UID: \"57795f7f-bb46-4703-a9be-be4cff367c87\") " pod="kuadrant-system/authorino-85c7bdb54-6hz66" Jul 12 21:54:14.720759 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.720721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw6b5\" (UniqueName: \"kubernetes.io/projected/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-kube-api-access-dw6b5\") pod \"authorino-865947c99d-6pksx\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:14.720946 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.720778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-tls-cert\") pod \"authorino-865947c99d-6pksx\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:14.821415 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.821378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-tls-cert\") pod \"authorino-865947c99d-6pksx\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:14.821610 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.821517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw6b5\" (UniqueName: \"kubernetes.io/projected/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-kube-api-access-dw6b5\") pod \"authorino-865947c99d-6pksx\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:14.823811 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.823789 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-tls-cert\") pod \"authorino-865947c99d-6pksx\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:14.829443 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.829418 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw6b5\" (UniqueName: \"kubernetes.io/projected/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-kube-api-access-dw6b5\") pod \"authorino-865947c99d-6pksx\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:14.879066 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:14.878992 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:54:15.010569 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.010545 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-865947c99d-6pksx"] Jul 12 21:54:15.012545 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:54:15.012520 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd8da3c2_49bb_4aab_a4eb_a41fcf658cd4.slice/crio-2654dd2a4da528625fe37c70813db0e2e7eb84dc2aa6b5135e09e3e82f5a1aa7 WatchSource:0}: Error finding container 2654dd2a4da528625fe37c70813db0e2e7eb84dc2aa6b5135e09e3e82f5a1aa7: Status 404 returned error can't find the container with id 2654dd2a4da528625fe37c70813db0e2e7eb84dc2aa6b5135e09e3e82f5a1aa7 Jul 12 21:54:15.098062 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.098035 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c7bdb54-6hz66" Jul 12 21:54:15.098062 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.098053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xzdnz" Jul 12 21:54:15.098236 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.098028 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865947c99d-6pksx" event={"ID":"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4","Type":"ContainerStarted","Data":"2654dd2a4da528625fe37c70813db0e2e7eb84dc2aa6b5135e09e3e82f5a1aa7"} Jul 12 21:54:15.105321 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.105303 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c7bdb54-6hz66" Jul 12 21:54:15.108274 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.108258 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xzdnz" Jul 12 21:54:15.225840 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.225762 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9p8j\" (UniqueName: \"kubernetes.io/projected/557dd193-c856-4201-a692-e399250ddc8f-kube-api-access-w9p8j\") pod \"557dd193-c856-4201-a692-e399250ddc8f\" (UID: \"557dd193-c856-4201-a692-e399250ddc8f\") " Jul 12 21:54:15.225840 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.225813 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdvd5\" (UniqueName: \"kubernetes.io/projected/57795f7f-bb46-4703-a9be-be4cff367c87-kube-api-access-zdvd5\") pod \"57795f7f-bb46-4703-a9be-be4cff367c87\" (UID: \"57795f7f-bb46-4703-a9be-be4cff367c87\") " Jul 12 21:54:15.227859 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.227830 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57795f7f-bb46-4703-a9be-be4cff367c87-kube-api-access-zdvd5" (OuterVolumeSpecName: "kube-api-access-zdvd5") pod "57795f7f-bb46-4703-a9be-be4cff367c87" (UID: "57795f7f-bb46-4703-a9be-be4cff367c87"). InnerVolumeSpecName "kube-api-access-zdvd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:54:15.227991 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.227873 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/557dd193-c856-4201-a692-e399250ddc8f-kube-api-access-w9p8j" (OuterVolumeSpecName: "kube-api-access-w9p8j") pod "557dd193-c856-4201-a692-e399250ddc8f" (UID: "557dd193-c856-4201-a692-e399250ddc8f"). InnerVolumeSpecName "kube-api-access-w9p8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:54:15.326860 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.326825 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9p8j\" (UniqueName: \"kubernetes.io/projected/557dd193-c856-4201-a692-e399250ddc8f-kube-api-access-w9p8j\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:54:15.326860 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:15.326852 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdvd5\" (UniqueName: \"kubernetes.io/projected/57795f7f-bb46-4703-a9be-be4cff367c87-kube-api-access-zdvd5\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:54:16.105639 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.105603 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865947c99d-6pksx" event={"ID":"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4","Type":"ContainerStarted","Data":"2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece"} Jul 12 21:54:16.105639 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.105635 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xzdnz" Jul 12 21:54:16.106096 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.105851 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85c7bdb54-6hz66" Jul 12 21:54:16.120936 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.120894 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-865947c99d-6pksx" podStartSLOduration=1.594958865 podStartE2EDuration="2.120877121s" totalImagesPullingTime="525.918256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:54:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:54:16.119141213 +0000 UTC m=+595.826598406" watchObservedRunningTime="2026-07-12 21:54:16.120877121 +0000 UTC m=+595.828334286" Jul 12 21:54:16.145841 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.145805 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xzdnz"] Jul 12 21:54:16.150030 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.149999 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7pcg9"] Jul 12 21:54:16.150260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.150214 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7pcg9" podUID="274a7fb0-af70-4d60-9190-c85db708060b" containerName="authorino" containerID="cri-o://6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee" gracePeriod=30 Jul 12 21:54:16.152785 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.152765 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xzdnz"] Jul 12 21:54:16.171797 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.171769 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85c7bdb54-6hz66"] Jul 12 21:54:16.178274 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.178243 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85c7bdb54-6hz66"] Jul 12 21:54:16.410276 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.410250 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7pcg9" Jul 12 21:54:16.540592 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.540561 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbsqj\" (UniqueName: \"kubernetes.io/projected/274a7fb0-af70-4d60-9190-c85db708060b-kube-api-access-rbsqj\") pod \"274a7fb0-af70-4d60-9190-c85db708060b\" (UID: \"274a7fb0-af70-4d60-9190-c85db708060b\") " Jul 12 21:54:16.542677 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.542653 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/274a7fb0-af70-4d60-9190-c85db708060b-kube-api-access-rbsqj" (OuterVolumeSpecName: "kube-api-access-rbsqj") pod "274a7fb0-af70-4d60-9190-c85db708060b" (UID: "274a7fb0-af70-4d60-9190-c85db708060b"). InnerVolumeSpecName "kube-api-access-rbsqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:54:16.641365 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:16.641279 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbsqj\" (UniqueName: \"kubernetes.io/projected/274a7fb0-af70-4d60-9190-c85db708060b-kube-api-access-rbsqj\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:54:17.000506 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.000424 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="557dd193-c856-4201-a692-e399250ddc8f" path="/var/lib/kubelet/pods/557dd193-c856-4201-a692-e399250ddc8f/volumes" Jul 12 21:54:17.000673 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.000660 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57795f7f-bb46-4703-a9be-be4cff367c87" path="/var/lib/kubelet/pods/57795f7f-bb46-4703-a9be-be4cff367c87/volumes" Jul 12 21:54:17.111837 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.111804 2573 generic.go:356] "Generic (PLEG): container finished" podID="274a7fb0-af70-4d60-9190-c85db708060b" containerID="6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee" exitCode=0 Jul 12 21:54:17.112316 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.111856 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7pcg9" event={"ID":"274a7fb0-af70-4d60-9190-c85db708060b","Type":"ContainerDied","Data":"6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee"} Jul 12 21:54:17.112316 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.111901 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7pcg9" event={"ID":"274a7fb0-af70-4d60-9190-c85db708060b","Type":"ContainerDied","Data":"68474e8dfcc81573a2498dddec59632216370022df87eb451e537ec877d11c93"} Jul 12 21:54:17.112316 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.111920 2573 scope.go:117] "RemoveContainer" containerID="6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee" Jul 12 21:54:17.112316 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.111866 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7pcg9" Jul 12 21:54:17.120761 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.120741 2573 scope.go:117] "RemoveContainer" containerID="6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee" Jul 12 21:54:17.121038 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:54:17.121019 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee\": container with ID starting with 6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee not found: ID does not exist" containerID="6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee" Jul 12 21:54:17.121096 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.121046 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee"} err="failed to get container status \"6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee\": rpc error: code = NotFound desc = could not find container \"6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee\": container with ID starting with 6d4c6b0647ef884e89c15eb8fcfda13f27db6a7a8619a5e1beac65a1c70e68ee not found: ID does not exist" Jul 12 21:54:17.128462 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.128442 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7pcg9"] Jul 12 21:54:17.134719 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:17.134699 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7pcg9"] Jul 12 21:54:19.000346 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:54:19.000317 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="274a7fb0-af70-4d60-9190-c85db708060b" path="/var/lib/kubelet/pods/274a7fb0-af70-4d60-9190-c85db708060b/volumes" Jul 12 21:55:03.385479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:03.385441 2573 generic.go:356] "Generic (PLEG): container finished" podID="3fb436b7-4e49-4c2b-a983-85f268685160" containerID="b60007176ca753f45a339911c1d682f872f134095fcb85580116ba51b1900c45" exitCode=0 Jul 12 21:55:03.385479 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:03.385478 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" event={"ID":"3fb436b7-4e49-4c2b-a983-85f268685160","Type":"ContainerDied","Data":"b60007176ca753f45a339911c1d682f872f134095fcb85580116ba51b1900c45"} Jul 12 21:55:03.385923 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:03.385842 2573 scope.go:117] "RemoveContainer" containerID="b60007176ca753f45a339911c1d682f872f134095fcb85580116ba51b1900c45" Jul 12 21:55:03.386858 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:03.386825 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:55:03.386936 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:03.386919 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:55:03.387016 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:03.386988 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 21:55:04.393012 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:04.392951 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" event={"ID":"3fb436b7-4e49-4c2b-a983-85f268685160","Type":"ContainerStarted","Data":"92f23b1d63422422d106ffac732c7c92e0af29896463f88c93cffa5caddfaa67"} Jul 12 21:55:04.488268 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:04.488233 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:55:05.012584 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:05.012548 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:55:05.013667 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:05.013643 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lpp8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 12 21:55:05.013742 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:05.013706 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" podUID="3fb436b7-4e49-4c2b-a983-85f268685160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 12 21:55:06.013646 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:06.013611 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lpp8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 12 21:55:06.014056 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:06.013665 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" podUID="3fb436b7-4e49-4c2b-a983-85f268685160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 12 21:55:07.013738 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:07.013698 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lpp8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 12 21:55:07.014243 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:07.013760 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" podUID="3fb436b7-4e49-4c2b-a983-85f268685160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 12 21:55:08.013638 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:08.013605 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lpp8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 12 21:55:08.013824 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:08.013659 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" podUID="3fb436b7-4e49-4c2b-a983-85f268685160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 12 21:55:09.017208 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:09.017180 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:55:09.018117 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:09.018095 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lpp8d" Jul 12 21:55:43.975092 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:43.975060 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c646b548-gfqk9"] Jul 12 21:55:43.975626 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:43.975426 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="274a7fb0-af70-4d60-9190-c85db708060b" containerName="authorino" Jul 12 21:55:43.975626 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:43.975438 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="274a7fb0-af70-4d60-9190-c85db708060b" containerName="authorino" Jul 12 21:55:43.975626 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:43.975513 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="274a7fb0-af70-4d60-9190-c85db708060b" containerName="authorino" Jul 12 21:55:43.978765 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:43.978744 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:43.981701 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:43.981679 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 12 21:55:43.990385 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:43.990360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c646b548-gfqk9"] Jul 12 21:55:44.028005 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.027958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dea5e480-85bc-4976-acd2-150e393b3714-oidc-ca\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.028131 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.028090 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26pr6\" (UniqueName: \"kubernetes.io/projected/dea5e480-85bc-4976-acd2-150e393b3714-kube-api-access-26pr6\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.028179 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.028151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dea5e480-85bc-4976-acd2-150e393b3714-tls-cert\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.129549 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.129509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26pr6\" (UniqueName: \"kubernetes.io/projected/dea5e480-85bc-4976-acd2-150e393b3714-kube-api-access-26pr6\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.129723 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.129560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dea5e480-85bc-4976-acd2-150e393b3714-tls-cert\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.129723 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.129610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dea5e480-85bc-4976-acd2-150e393b3714-oidc-ca\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.130276 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.130251 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dea5e480-85bc-4976-acd2-150e393b3714-oidc-ca\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.132094 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.132072 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dea5e480-85bc-4976-acd2-150e393b3714-tls-cert\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.145932 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.145906 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26pr6\" (UniqueName: \"kubernetes.io/projected/dea5e480-85bc-4976-acd2-150e393b3714-kube-api-access-26pr6\") pod \"authorino-56c646b548-gfqk9\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.288538 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.288451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:55:44.425902 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.425869 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c646b548-gfqk9"] Jul 12 21:55:44.427269 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:55:44.427245 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddea5e480_85bc_4976_acd2_150e393b3714.slice/crio-a04df5c74caf025ac47381e5735a25c126c931e4f372d3e3fac9cf87c2f56dd9 WatchSource:0}: Error finding container a04df5c74caf025ac47381e5735a25c126c931e4f372d3e3fac9cf87c2f56dd9: Status 404 returned error can't find the container with id a04df5c74caf025ac47381e5735a25c126c931e4f372d3e3fac9cf87c2f56dd9 Jul 12 21:55:44.428601 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.428585 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 21:55:44.613525 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:44.613494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c646b548-gfqk9" event={"ID":"dea5e480-85bc-4976-acd2-150e393b3714","Type":"ContainerStarted","Data":"a04df5c74caf025ac47381e5735a25c126c931e4f372d3e3fac9cf87c2f56dd9"} Jul 12 21:55:45.620508 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:45.620468 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c646b548-gfqk9" event={"ID":"dea5e480-85bc-4976-acd2-150e393b3714","Type":"ContainerStarted","Data":"db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179"} Jul 12 21:55:45.638513 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:45.638461 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56c646b548-gfqk9" podStartSLOduration=2.247171389 podStartE2EDuration="2.638445265s" totalImagesPullingTime="391.273876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:55:45.637357669 +0000 UTC m=+685.344814859" watchObservedRunningTime="2026-07-12 21:55:45.638445265 +0000 UTC m=+685.345902442" Jul 12 21:55:45.668872 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:45.668805 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-865947c99d-6pksx"] Jul 12 21:55:45.669070 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:45.669038 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-865947c99d-6pksx" podUID="fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" containerName="authorino" containerID="cri-o://2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece" gracePeriod=30 Jul 12 21:55:45.929690 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:45.929669 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:55:46.047440 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.047410 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw6b5\" (UniqueName: \"kubernetes.io/projected/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-kube-api-access-dw6b5\") pod \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " Jul 12 21:55:46.047614 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.047459 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-tls-cert\") pod \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\" (UID: \"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4\") " Jul 12 21:55:46.049541 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.049508 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-kube-api-access-dw6b5" (OuterVolumeSpecName: "kube-api-access-dw6b5") pod "fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" (UID: "fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4"). InnerVolumeSpecName "kube-api-access-dw6b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:55:46.058123 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.058097 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" (UID: "fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:55:46.148764 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.148716 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw6b5\" (UniqueName: \"kubernetes.io/projected/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-kube-api-access-dw6b5\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:55:46.148764 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.148758 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4-tls-cert\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:55:46.628382 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.628345 2573 generic.go:356] "Generic (PLEG): container finished" podID="fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" containerID="2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece" exitCode=0 Jul 12 21:55:46.628866 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.628381 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865947c99d-6pksx" event={"ID":"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4","Type":"ContainerDied","Data":"2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece"} Jul 12 21:55:46.628866 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.628424 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865947c99d-6pksx" event={"ID":"fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4","Type":"ContainerDied","Data":"2654dd2a4da528625fe37c70813db0e2e7eb84dc2aa6b5135e09e3e82f5a1aa7"} Jul 12 21:55:46.628866 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.628442 2573 scope.go:117] "RemoveContainer" containerID="2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece" Jul 12 21:55:46.628866 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.628388 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865947c99d-6pksx" Jul 12 21:55:46.637539 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.637525 2573 scope.go:117] "RemoveContainer" containerID="2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece" Jul 12 21:55:46.637778 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:55:46.637760 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece\": container with ID starting with 2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece not found: ID does not exist" containerID="2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece" Jul 12 21:55:46.637827 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.637786 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece"} err="failed to get container status \"2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece\": rpc error: code = NotFound desc = could not find container \"2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece\": container with ID starting with 2d6976940043992fa0c5cbfbf21cc135043da262637842e70693df41fdf08ece not found: ID does not exist" Jul 12 21:55:46.667759 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.667736 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-865947c99d-6pksx"] Jul 12 21:55:46.675723 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:46.675701 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-865947c99d-6pksx"] Jul 12 21:55:47.001163 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:55:47.001069 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" path="/var/lib/kubelet/pods/fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4/volumes" Jul 12 21:58:30.897862 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:30.897814 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d6447fd9-ffqjr"] Jul 12 21:58:30.898700 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:30.898674 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" containerName="authorino" Jul 12 21:58:30.898803 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:30.898704 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" containerName="authorino" Jul 12 21:58:30.898927 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:30.898914 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8da3c2-49bb-4aab-a4eb-a41fcf658cd4" containerName="authorino" Jul 12 21:58:30.902661 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:30.902637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:30.910891 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:30.910859 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6447fd9-ffqjr"] Jul 12 21:58:31.040973 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.040936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b29cc\" (UniqueName: \"kubernetes.io/projected/a1f4be57-e959-4214-8308-f18982c2113a-kube-api-access-b29cc\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.041145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.041047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a1f4be57-e959-4214-8308-f18982c2113a-tls-cert\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.041145 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.041074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a1f4be57-e959-4214-8308-f18982c2113a-oidc-ca\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.142100 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.142067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b29cc\" (UniqueName: \"kubernetes.io/projected/a1f4be57-e959-4214-8308-f18982c2113a-kube-api-access-b29cc\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.142271 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.142111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a1f4be57-e959-4214-8308-f18982c2113a-tls-cert\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.142271 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.142137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a1f4be57-e959-4214-8308-f18982c2113a-oidc-ca\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.142829 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.142811 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a1f4be57-e959-4214-8308-f18982c2113a-oidc-ca\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.144675 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.144649 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a1f4be57-e959-4214-8308-f18982c2113a-tls-cert\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.151090 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.151034 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b29cc\" (UniqueName: \"kubernetes.io/projected/a1f4be57-e959-4214-8308-f18982c2113a-kube-api-access-b29cc\") pod \"authorino-7d6447fd9-ffqjr\" (UID: \"a1f4be57-e959-4214-8308-f18982c2113a\") " pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.212720 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.212694 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6447fd9-ffqjr" Jul 12 21:58:31.370946 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.370921 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6447fd9-ffqjr"] Jul 12 21:58:31.372794 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:58:31.372758 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1f4be57_e959_4214_8308_f18982c2113a.slice/crio-92029ed120977f91029bf13e2a8763159ffe26b93be4f9124f28d1cf206945f5 WatchSource:0}: Error finding container 92029ed120977f91029bf13e2a8763159ffe26b93be4f9124f28d1cf206945f5: Status 404 returned error can't find the container with id 92029ed120977f91029bf13e2a8763159ffe26b93be4f9124f28d1cf206945f5 Jul 12 21:58:31.527211 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:31.527128 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6447fd9-ffqjr" event={"ID":"a1f4be57-e959-4214-8308-f18982c2113a","Type":"ContainerStarted","Data":"92029ed120977f91029bf13e2a8763159ffe26b93be4f9124f28d1cf206945f5"} Jul 12 21:58:32.537301 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:32.537265 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6447fd9-ffqjr" event={"ID":"a1f4be57-e959-4214-8308-f18982c2113a","Type":"ContainerStarted","Data":"e8d7bbb056f0555fcac07224a8bd0e84557d3b32dd5c6002e9bd681606145f62"} Jul 12 21:58:32.589243 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:32.589179 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d6447fd9-ffqjr" podStartSLOduration=2.252300244 podStartE2EDuration="2.589162574s" totalImagesPullingTime="336.86233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:32.586829181 +0000 UTC m=+852.294286363" watchObservedRunningTime="2026-07-12 21:58:32.589162574 +0000 UTC m=+852.296619738" Jul 12 21:58:32.652518 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:32.652476 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c646b548-gfqk9"] Jul 12 21:58:32.652714 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:32.652687 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56c646b548-gfqk9" podUID="dea5e480-85bc-4976-acd2-150e393b3714" containerName="authorino" containerID="cri-o://db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179" gracePeriod=30 Jul 12 21:58:32.932320 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:32.932294 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:58:33.061067 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.061034 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dea5e480-85bc-4976-acd2-150e393b3714-oidc-ca\") pod \"dea5e480-85bc-4976-acd2-150e393b3714\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " Jul 12 21:58:33.061273 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.061170 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dea5e480-85bc-4976-acd2-150e393b3714-tls-cert\") pod \"dea5e480-85bc-4976-acd2-150e393b3714\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " Jul 12 21:58:33.061273 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.061216 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26pr6\" (UniqueName: \"kubernetes.io/projected/dea5e480-85bc-4976-acd2-150e393b3714-kube-api-access-26pr6\") pod \"dea5e480-85bc-4976-acd2-150e393b3714\" (UID: \"dea5e480-85bc-4976-acd2-150e393b3714\") " Jul 12 21:58:33.063427 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.063392 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dea5e480-85bc-4976-acd2-150e393b3714-kube-api-access-26pr6" (OuterVolumeSpecName: "kube-api-access-26pr6") pod "dea5e480-85bc-4976-acd2-150e393b3714" (UID: "dea5e480-85bc-4976-acd2-150e393b3714"). InnerVolumeSpecName "kube-api-access-26pr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 21:58:33.068086 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.068062 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dea5e480-85bc-4976-acd2-150e393b3714-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "dea5e480-85bc-4976-acd2-150e393b3714" (UID: "dea5e480-85bc-4976-acd2-150e393b3714"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 21:58:33.072781 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.072759 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea5e480-85bc-4976-acd2-150e393b3714-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dea5e480-85bc-4976-acd2-150e393b3714" (UID: "dea5e480-85bc-4976-acd2-150e393b3714"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 21:58:33.163404 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.163365 2573 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dea5e480-85bc-4976-acd2-150e393b3714-oidc-ca\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:58:33.163404 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.163404 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dea5e480-85bc-4976-acd2-150e393b3714-tls-cert\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:58:33.163625 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.163418 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26pr6\" (UniqueName: \"kubernetes.io/projected/dea5e480-85bc-4976-acd2-150e393b3714-kube-api-access-26pr6\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 21:58:33.545246 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.545141 2573 generic.go:356] "Generic (PLEG): container finished" podID="dea5e480-85bc-4976-acd2-150e393b3714" containerID="db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179" exitCode=0 Jul 12 21:58:33.545246 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.545209 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c646b548-gfqk9" Jul 12 21:58:33.545246 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.545233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c646b548-gfqk9" event={"ID":"dea5e480-85bc-4976-acd2-150e393b3714","Type":"ContainerDied","Data":"db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179"} Jul 12 21:58:33.545813 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.545280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c646b548-gfqk9" event={"ID":"dea5e480-85bc-4976-acd2-150e393b3714","Type":"ContainerDied","Data":"a04df5c74caf025ac47381e5735a25c126c931e4f372d3e3fac9cf87c2f56dd9"} Jul 12 21:58:33.545813 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.545326 2573 scope.go:117] "RemoveContainer" containerID="db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179" Jul 12 21:58:33.555080 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.555057 2573 scope.go:117] "RemoveContainer" containerID="db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179" Jul 12 21:58:33.555350 ip-10-0-128-127 kubenswrapper[2573]: E0712 21:58:33.555323 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179\": container with ID starting with db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179 not found: ID does not exist" containerID="db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179" Jul 12 21:58:33.555409 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.555362 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179"} err="failed to get container status \"db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179\": rpc error: code = NotFound desc = could not find container \"db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179\": container with ID starting with db2554e7e6de1e351a591fdab285c6d9c3476edbaaad681b32740c7f65850179 not found: ID does not exist" Jul 12 21:58:33.572267 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.572228 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c646b548-gfqk9"] Jul 12 21:58:33.575094 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:33.575072 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c646b548-gfqk9"] Jul 12 21:58:35.001472 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:58:35.001440 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dea5e480-85bc-4976-acd2-150e393b3714" path="/var/lib/kubelet/pods/dea5e480-85bc-4976-acd2-150e393b3714/volumes" Jul 12 21:59:40.195349 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:40.195316 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6447fd9-ffqjr_a1f4be57-e959-4214-8308-f18982c2113a/authorino/0.log" Jul 12 21:59:45.505225 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:45.505196 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5557dd54c4-dnv7f_f1ae7c1c-ca2f-421b-b597-25519623bc0f/copy-manifests/0.log" Jul 12 21:59:45.511647 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:45.511614 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5557dd54c4-dnv7f_f1ae7c1c-ca2f-421b-b597-25519623bc0f/manager/0.log" Jul 12 21:59:45.730476 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:45.730443 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-np7qm_79fd9645-6937-41cf-85ec-09630a2cfcb9/postgres/0.log" Jul 12 21:59:46.474703 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.474671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9_de2a5f53-a0cc-449a-9cbd-f7d064a628aa/util/0.log" Jul 12 21:59:46.481016 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.480984 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9_de2a5f53-a0cc-449a-9cbd-f7d064a628aa/pull/0.log" Jul 12 21:59:46.487260 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.487242 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9_de2a5f53-a0cc-449a-9cbd-f7d064a628aa/extract/0.log" Jul 12 21:59:46.596138 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.596109 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j_cc1bfc58-74d0-4764-b5cc-1d5e466d6e93/util/0.log" Jul 12 21:59:46.603164 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.603140 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j_cc1bfc58-74d0-4764-b5cc-1d5e466d6e93/pull/0.log" Jul 12 21:59:46.610176 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.610155 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j_cc1bfc58-74d0-4764-b5cc-1d5e466d6e93/extract/0.log" Jul 12 21:59:46.718643 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.718602 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v_7d264cec-b1e6-411b-94d8-e03301b19479/util/0.log" Jul 12 21:59:46.725373 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.725303 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v_7d264cec-b1e6-411b-94d8-e03301b19479/pull/0.log" Jul 12 21:59:46.731828 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.731802 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v_7d264cec-b1e6-411b-94d8-e03301b19479/extract/0.log" Jul 12 21:59:46.840598 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.840567 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh_4a986dfc-b9c6-4744-b104-927880558339/util/0.log" Jul 12 21:59:46.848117 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.848090 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh_4a986dfc-b9c6-4744-b104-927880558339/pull/0.log" Jul 12 21:59:46.854198 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.854163 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh_4a986dfc-b9c6-4744-b104-927880558339/extract/0.log" Jul 12 21:59:46.974487 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:46.974459 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6447fd9-ffqjr_a1f4be57-e959-4214-8308-f18982c2113a/authorino/0.log" Jul 12 21:59:47.447323 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:47.447280 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2st5m_e2ae5fa0-543e-4d80-bb02-7bebf38aaa99/registry-server/0.log" Jul 12 21:59:47.570986 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:47.570935 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gwpc6_b2d97215-1871-4b40-a6f8-6809240dae28/manager/0.log" Jul 12 21:59:48.161721 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:48.161695 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p66kh_4536f46a-92a8-48ce-83a7-bc05f5a62b8d/istio-proxy/0.log" Jul 12 21:59:48.618257 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:48.618226 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lpp8d_3fb436b7-4e49-4c2b-a983-85f268685160/istio-proxy/1.log" Jul 12 21:59:53.836067 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.836030 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-68zbj/must-gather-7jhzb"] Jul 12 21:59:53.836588 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.836420 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dea5e480-85bc-4976-acd2-150e393b3714" containerName="authorino" Jul 12 21:59:53.836588 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.836431 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea5e480-85bc-4976-acd2-150e393b3714" containerName="authorino" Jul 12 21:59:53.836588 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.836493 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dea5e480-85bc-4976-acd2-150e393b3714" containerName="authorino" Jul 12 21:59:53.839621 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.839604 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:53.845283 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.845260 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-68zbj\"/\"default-dockercfg-2q9jc\"" Jul 12 21:59:53.845520 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.845293 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68zbj\"/\"kube-root-ca.crt\"" Jul 12 21:59:53.845671 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.845412 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68zbj\"/\"openshift-service-ca.crt\"" Jul 12 21:59:53.852670 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.852648 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68zbj/must-gather-7jhzb"] Jul 12 21:59:53.911630 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.911594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8a363b3-891f-4159-85e0-f58f457ef208-must-gather-output\") pod \"must-gather-7jhzb\" (UID: \"d8a363b3-891f-4159-85e0-f58f457ef208\") " pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:53.911811 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:53.911681 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hwbt\" (UniqueName: \"kubernetes.io/projected/d8a363b3-891f-4159-85e0-f58f457ef208-kube-api-access-8hwbt\") pod \"must-gather-7jhzb\" (UID: \"d8a363b3-891f-4159-85e0-f58f457ef208\") " pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:54.012139 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:54.012108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hwbt\" (UniqueName: \"kubernetes.io/projected/d8a363b3-891f-4159-85e0-f58f457ef208-kube-api-access-8hwbt\") pod \"must-gather-7jhzb\" (UID: \"d8a363b3-891f-4159-85e0-f58f457ef208\") " pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:54.012342 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:54.012200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8a363b3-891f-4159-85e0-f58f457ef208-must-gather-output\") pod \"must-gather-7jhzb\" (UID: \"d8a363b3-891f-4159-85e0-f58f457ef208\") " pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:54.012545 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:54.012525 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8a363b3-891f-4159-85e0-f58f457ef208-must-gather-output\") pod \"must-gather-7jhzb\" (UID: \"d8a363b3-891f-4159-85e0-f58f457ef208\") " pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:54.024939 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:54.024916 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hwbt\" (UniqueName: \"kubernetes.io/projected/d8a363b3-891f-4159-85e0-f58f457ef208-kube-api-access-8hwbt\") pod \"must-gather-7jhzb\" (UID: \"d8a363b3-891f-4159-85e0-f58f457ef208\") " pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:54.148790 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:54.148708 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68zbj/must-gather-7jhzb" Jul 12 21:59:54.300907 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:54.300872 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68zbj/must-gather-7jhzb"] Jul 12 21:59:54.305714 ip-10-0-128-127 kubenswrapper[2573]: W0712 21:59:54.305679 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8a363b3_891f_4159_85e0_f58f457ef208.slice/crio-c7aebfaf8ac442b099419430a4ee5f500a49948144ff3b6f42739f57730fad31 WatchSource:0}: Error finding container c7aebfaf8ac442b099419430a4ee5f500a49948144ff3b6f42739f57730fad31: Status 404 returned error can't find the container with id c7aebfaf8ac442b099419430a4ee5f500a49948144ff3b6f42739f57730fad31 Jul 12 21:59:55.007645 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:55.007617 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68zbj/must-gather-7jhzb" event={"ID":"d8a363b3-891f-4159-85e0-f58f457ef208","Type":"ContainerStarted","Data":"c7aebfaf8ac442b099419430a4ee5f500a49948144ff3b6f42739f57730fad31"} Jul 12 21:59:56.016903 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:56.016858 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68zbj/must-gather-7jhzb" event={"ID":"d8a363b3-891f-4159-85e0-f58f457ef208","Type":"ContainerStarted","Data":"6bc674c5e2e74cd9bcb53df4f3bd964031fa7d6c0cb35389fe2f84316ff70ca2"} Jul 12 21:59:56.017385 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:56.016917 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68zbj/must-gather-7jhzb" event={"ID":"d8a363b3-891f-4159-85e0-f58f457ef208","Type":"ContainerStarted","Data":"61d2d3eec2f14fa7ed1258df4d41fe65ea71323fd347aa6ca96cdfd0341eff8c"} Jul 12 21:59:56.036529 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:56.036463 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-68zbj/must-gather-7jhzb" podStartSLOduration=2.398813386 podStartE2EDuration="3.036441235s" totalImagesPullingTime="637.627849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:59:56.033067624 +0000 UTC m=+935.740524801" watchObservedRunningTime="2026-07-12 21:59:56.036441235 +0000 UTC m=+935.743898400" Jul 12 21:59:56.668391 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:56.668336 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-px4vm_fceae72a-b383-4da9-a08d-05093e40b365/global-pull-secret-syncer/0.log" Jul 12 21:59:56.753487 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:56.753450 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p864t_acae90cb-4c9a-4030-a037-e6a9e5fc08b4/konnectivity-agent/0.log" Jul 12 21:59:56.802573 ip-10-0-128-127 kubenswrapper[2573]: I0712 21:59:56.802542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-127.ec2.internal_8c0fbe03dcb71398a547458685400965/haproxy/0.log" Jul 12 22:00:00.159121 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.159083 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29731560-jjqc2"] Jul 12 22:00:00.165575 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.165548 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" Jul 12 22:00:00.168553 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.168529 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nxz95\"" Jul 12 22:00:00.170840 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.170793 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29731560-jjqc2"] Jul 12 22:00:00.292311 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.292259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68xkh\" (UniqueName: \"kubernetes.io/projected/f6e13556-bed4-4be4-b7af-c43f1ccaff74-kube-api-access-68xkh\") pod \"maas-api-key-cleanup-29731560-jjqc2\" (UID: \"f6e13556-bed4-4be4-b7af-c43f1ccaff74\") " pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" Jul 12 22:00:00.394178 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.393729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68xkh\" (UniqueName: \"kubernetes.io/projected/f6e13556-bed4-4be4-b7af-c43f1ccaff74-kube-api-access-68xkh\") pod \"maas-api-key-cleanup-29731560-jjqc2\" (UID: \"f6e13556-bed4-4be4-b7af-c43f1ccaff74\") " pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" Jul 12 22:00:00.414007 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.413892 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68xkh\" (UniqueName: \"kubernetes.io/projected/f6e13556-bed4-4be4-b7af-c43f1ccaff74-kube-api-access-68xkh\") pod \"maas-api-key-cleanup-29731560-jjqc2\" (UID: \"f6e13556-bed4-4be4-b7af-c43f1ccaff74\") " pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" Jul 12 22:00:00.493055 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.493006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" Jul 12 22:00:00.680565 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.680520 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9_de2a5f53-a0cc-449a-9cbd-f7d064a628aa/extract/0.log" Jul 12 22:00:00.767167 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.767030 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9_de2a5f53-a0cc-449a-9cbd-f7d064a628aa/util/0.log" Jul 12 22:00:00.807315 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.806373 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29731560-jjqc2"] Jul 12 22:00:00.848986 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.845580 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gkqf9_de2a5f53-a0cc-449a-9cbd-f7d064a628aa/pull/0.log" Jul 12 22:00:00.897982 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.895851 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j_cc1bfc58-74d0-4764-b5cc-1d5e466d6e93/extract/0.log" Jul 12 22:00:00.941033 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.940401 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j_cc1bfc58-74d0-4764-b5cc-1d5e466d6e93/util/0.log" Jul 12 22:00:00.970221 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:00.969800 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0svr9j_cc1bfc58-74d0-4764-b5cc-1d5e466d6e93/pull/0.log" Jul 12 22:00:01.018983 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.017843 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v_7d264cec-b1e6-411b-94d8-e03301b19479/extract/0.log" Jul 12 22:00:01.049464 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.049418 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v_7d264cec-b1e6-411b-94d8-e03301b19479/util/0.log" Jul 12 22:00:01.068039 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.068007 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" event={"ID":"f6e13556-bed4-4be4-b7af-c43f1ccaff74","Type":"ContainerStarted","Data":"06287cf81c6e0729e15bd5ade530435167325aa879ad082c9d8dcf7361b18a32"} Jul 12 22:00:01.078496 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.078467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ksj9v_7d264cec-b1e6-411b-94d8-e03301b19479/pull/0.log" Jul 12 22:00:01.112738 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.112710 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh_4a986dfc-b9c6-4744-b104-927880558339/extract/0.log" Jul 12 22:00:01.145247 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.145214 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh_4a986dfc-b9c6-4744-b104-927880558339/util/0.log" Jul 12 22:00:01.174264 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.174230 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhwdh_4a986dfc-b9c6-4744-b104-927880558339/pull/0.log" Jul 12 22:00:01.820087 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.818219 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6447fd9-ffqjr_a1f4be57-e959-4214-8308-f18982c2113a/authorino/0.log" Jul 12 22:00:01.971105 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:01.971063 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2st5m_e2ae5fa0-543e-4d80-bb02-7bebf38aaa99/registry-server/0.log" Jul 12 22:00:02.014645 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:02.014607 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gwpc6_b2d97215-1871-4b40-a6f8-6809240dae28/manager/0.log" Jul 12 22:00:03.790194 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:03.790160 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3/alertmanager/0.log" Jul 12 22:00:03.820559 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:03.820520 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3/config-reloader/0.log" Jul 12 22:00:03.850551 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:03.850515 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3/kube-rbac-proxy-web/0.log" Jul 12 22:00:03.875215 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:03.875183 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3/kube-rbac-proxy/0.log" Jul 12 22:00:03.902384 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:03.902351 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3/kube-rbac-proxy-metric/0.log" Jul 12 22:00:03.933525 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:03.933488 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3/prom-label-proxy/0.log" Jul 12 22:00:03.955602 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:03.955569 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7904be8-9a46-4a27-96bb-5cf2ee4fbbc3/init-config-reloader/0.log" Jul 12 22:00:04.013310 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.013275 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rg4xw_92277741-3de3-40e8-96b0-99108a3fff36/cluster-monitoring-operator/0.log" Jul 12 22:00:04.132039 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.132002 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b9bb57946-fm9ww_54f404c7-5019-4fd6-98de-bc2db7013921/metrics-server/0.log" Jul 12 22:00:04.197345 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.197311 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qznq_b4922907-52ae-46fd-b200-3505a5a5fada/node-exporter/0.log" Jul 12 22:00:04.225874 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.225841 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qznq_b4922907-52ae-46fd-b200-3505a5a5fada/kube-rbac-proxy/0.log" Jul 12 22:00:04.263595 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.263566 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qznq_b4922907-52ae-46fd-b200-3505a5a5fada/init-textfile/0.log" Jul 12 22:00:04.813570 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.813488 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-s2htg_be56b2b8-3b07-4239-b026-5730cedb09cc/prometheus-operator/0.log" Jul 12 22:00:04.839478 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.839337 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-s2htg_be56b2b8-3b07-4239-b026-5730cedb09cc/kube-rbac-proxy/0.log" Jul 12 22:00:04.868831 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.868798 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-fqh7s_71fc858c-48f0-4366-92b0-f6b21fad9b81/prometheus-operator-admission-webhook/0.log" Jul 12 22:00:04.922910 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.922204 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78c8b5fcfd-lkmln_b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0/telemeter-client/0.log" Jul 12 22:00:04.947658 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.947626 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78c8b5fcfd-lkmln_b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0/reload/0.log" Jul 12 22:00:04.975609 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:04.975386 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78c8b5fcfd-lkmln_b4dd3e10-9ac6-484d-80d7-1df8ff51a8d0/kube-rbac-proxy/0.log" Jul 12 22:00:05.039826 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:05.039791 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77c495ffb-nrmv4_b1be33ef-253f-4e96-8f6d-b01f175d64a1/thanos-query/0.log" Jul 12 22:00:05.061363 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:05.061319 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77c495ffb-nrmv4_b1be33ef-253f-4e96-8f6d-b01f175d64a1/kube-rbac-proxy-web/0.log" Jul 12 22:00:05.086040 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:05.085867 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77c495ffb-nrmv4_b1be33ef-253f-4e96-8f6d-b01f175d64a1/kube-rbac-proxy/0.log" Jul 12 22:00:05.112239 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:05.112096 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77c495ffb-nrmv4_b1be33ef-253f-4e96-8f6d-b01f175d64a1/prom-label-proxy/0.log" Jul 12 22:00:05.140515 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:05.140482 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77c495ffb-nrmv4_b1be33ef-253f-4e96-8f6d-b01f175d64a1/kube-rbac-proxy-rules/0.log" Jul 12 22:00:05.168086 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:05.167608 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77c495ffb-nrmv4_b1be33ef-253f-4e96-8f6d-b01f175d64a1/kube-rbac-proxy-metrics/0.log" Jul 12 22:00:06.608935 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:06.608899 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-vtsnp_dd8d4ee9-68e7-4544-a7e1-0a7b344d771d/networking-console-plugin/0.log" Jul 12 22:00:07.353135 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.353095 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb"] Jul 12 22:00:07.357860 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.357839 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.369641 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.369613 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb"] Jul 12 22:00:07.394556 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.394524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-sys\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.394789 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.394770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75pj5\" (UniqueName: \"kubernetes.io/projected/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-kube-api-access-75pj5\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.394912 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.394898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-lib-modules\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.395071 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.395055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-podres\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.395328 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.395179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-proc\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.495729 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-sys\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.495913 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75pj5\" (UniqueName: \"kubernetes.io/projected/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-kube-api-access-75pj5\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.495913 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-lib-modules\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.495913 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495792 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-podres\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.495913 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-proc\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.495913 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495851 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-sys\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.495913 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495909 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-proc\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.496213 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495934 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-lib-modules\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.496213 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.495977 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-podres\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.505284 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.505259 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75pj5\" (UniqueName: \"kubernetes.io/projected/217336b1-6e8e-4a9b-8e56-18a39dd3c9ee-kube-api-access-75pj5\") pod \"perf-node-gather-daemonset-cnpfb\" (UID: \"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee\") " pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.677266 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.677182 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:07.859470 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:07.859425 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb"] Jul 12 22:00:07.863059 ip-10-0-128-127 kubenswrapper[2573]: W0712 22:00:07.863002 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod217336b1_6e8e_4a9b_8e56_18a39dd3c9ee.slice/crio-a4c82c869c8810f114f93f2ffe7f27e7dfce68085239f8ab3a68bacbe839315c WatchSource:0}: Error finding container a4c82c869c8810f114f93f2ffe7f27e7dfce68085239f8ab3a68bacbe839315c: Status 404 returned error can't find the container with id a4c82c869c8810f114f93f2ffe7f27e7dfce68085239f8ab3a68bacbe839315c Jul 12 22:00:08.004041 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:08.004008 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-744df6c7f6-dhzgg_936553f9-e80a-4f09-95ec-c82ac0669c94/console/0.log" Jul 12 22:00:08.138953 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:08.138911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" event={"ID":"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee","Type":"ContainerStarted","Data":"4d14f7ae436f5156cfe6488f8350a55125a8d81c435f0381c4bd41e995a16499"} Jul 12 22:00:08.139172 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:08.138993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" event={"ID":"217336b1-6e8e-4a9b-8e56-18a39dd3c9ee","Type":"ContainerStarted","Data":"a4c82c869c8810f114f93f2ffe7f27e7dfce68085239f8ab3a68bacbe839315c"} Jul 12 22:00:08.139172 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:08.139024 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:08.141086 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:08.141053 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" event={"ID":"f6e13556-bed4-4be4-b7af-c43f1ccaff74","Type":"ContainerStarted","Data":"3d6cda0ed3c6d7c87d38b98806c0681411855ae05c789243fccaa8efbbfad1f0"} Jul 12 22:00:08.159138 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:08.159069 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" podStartSLOduration=1.159048243 podStartE2EDuration="1.159048243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 22:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:00:08.157469978 +0000 UTC m=+947.864927145" watchObservedRunningTime="2026-07-12 22:00:08.159048243 +0000 UTC m=+947.866505408" Jul 12 22:00:08.178104 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:08.178047 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" podStartSLOduration=2.000317755 podStartE2EDuration="8.178028935s" totalImagesPullingTime="6.17771118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:00:08.176198945 +0000 UTC m=+947.883656132" watchObservedRunningTime="2026-07-12 22:00:08.178028935 +0000 UTC m=+947.885486099" Jul 12 22:00:09.149669 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:09.149633 2573 generic.go:356] "Generic (PLEG): container finished" podID="f6e13556-bed4-4be4-b7af-c43f1ccaff74" containerID="3d6cda0ed3c6d7c87d38b98806c0681411855ae05c789243fccaa8efbbfad1f0" exitCode=0 Jul 12 22:00:09.150119 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:09.149712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" event={"ID":"f6e13556-bed4-4be4-b7af-c43f1ccaff74","Type":"ContainerDied","Data":"3d6cda0ed3c6d7c87d38b98806c0681411855ae05c789243fccaa8efbbfad1f0"} Jul 12 22:00:09.857028 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:09.856999 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wcfn9_d4ada1d2-c7d2-407e-8537-2991ee7cb1d3/dns/0.log" Jul 12 22:00:09.883284 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:09.883248 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wcfn9_d4ada1d2-c7d2-407e-8537-2991ee7cb1d3/kube-rbac-proxy/0.log" Jul 12 22:00:10.017307 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:10.017273 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wk2cf_882769a3-67e0-400d-9f40-df2c7206dc93/dns-node-resolver/0.log" Jul 12 22:00:10.327339 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:10.327308 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" Jul 12 22:00:10.424420 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:10.424321 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68xkh\" (UniqueName: \"kubernetes.io/projected/f6e13556-bed4-4be4-b7af-c43f1ccaff74-kube-api-access-68xkh\") pod \"f6e13556-bed4-4be4-b7af-c43f1ccaff74\" (UID: \"f6e13556-bed4-4be4-b7af-c43f1ccaff74\") " Jul 12 22:00:10.428298 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:10.428263 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6e13556-bed4-4be4-b7af-c43f1ccaff74-kube-api-access-68xkh" (OuterVolumeSpecName: "kube-api-access-68xkh") pod "f6e13556-bed4-4be4-b7af-c43f1ccaff74" (UID: "f6e13556-bed4-4be4-b7af-c43f1ccaff74"). InnerVolumeSpecName "kube-api-access-68xkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 22:00:10.526497 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:10.526458 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68xkh\" (UniqueName: \"kubernetes.io/projected/f6e13556-bed4-4be4-b7af-c43f1ccaff74-kube-api-access-68xkh\") on node \"ip-10-0-128-127.ec2.internal\" DevicePath \"\"" Jul 12 22:00:10.708681 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:10.708589 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jms4q_dd5ad664-50df-4fab-837f-9606b29cab11/node-ca/0.log" Jul 12 22:00:11.167630 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:11.167604 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" Jul 12 22:00:11.167868 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:11.167648 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29731560-jjqc2" event={"ID":"f6e13556-bed4-4be4-b7af-c43f1ccaff74","Type":"ContainerDied","Data":"06287cf81c6e0729e15bd5ade530435167325aa879ad082c9d8dcf7361b18a32"} Jul 12 22:00:11.167868 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:11.167698 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06287cf81c6e0729e15bd5ade530435167325aa879ad082c9d8dcf7361b18a32" Jul 12 22:00:11.774285 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:11.774257 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p66kh_4536f46a-92a8-48ce-83a7-bc05f5a62b8d/istio-proxy/0.log" Jul 12 22:00:11.929098 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:11.929065 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lpp8d_3fb436b7-4e49-4c2b-a983-85f268685160/istio-proxy/0.log" Jul 12 22:00:12.238918 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:12.237755 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lpp8d_3fb436b7-4e49-4c2b-a983-85f268685160/istio-proxy/1.log" Jul 12 22:00:13.066096 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:13.066070 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8j7x_0fb8ede1-b2ee-45d7-b127-69f2a42061d9/serve-healthcheck-canary/0.log" Jul 12 22:00:13.663299 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:13.663231 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9x9bt_94624b5d-31dc-4643-95ec-85f3c7ea6756/kube-rbac-proxy/0.log" Jul 12 22:00:13.690868 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:13.690842 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9x9bt_94624b5d-31dc-4643-95ec-85f3c7ea6756/exporter/0.log" Jul 12 22:00:13.721069 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:13.721038 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9x9bt_94624b5d-31dc-4643-95ec-85f3c7ea6756/extractor/0.log" Jul 12 22:00:14.163271 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:14.163200 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-68zbj/perf-node-gather-daemonset-cnpfb" Jul 12 22:00:16.463776 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:16.463741 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29731560-jjqc2_f6e13556-bed4-4be4-b7af-c43f1ccaff74/cleanup/0.log" Jul 12 22:00:16.713802 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:16.713713 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5557dd54c4-dnv7f_f1ae7c1c-ca2f-421b-b597-25519623bc0f/manager/0.log" Jul 12 22:00:16.739564 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:16.739530 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5557dd54c4-dnv7f_f1ae7c1c-ca2f-421b-b597-25519623bc0f/copy-manifests/0.log" Jul 12 22:00:16.888368 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:16.888337 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-np7qm_79fd9645-6937-41cf-85ec-09630a2cfcb9/postgres/0.log" Jul 12 22:00:17.808219 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:17.808144 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p66kh_4536f46a-92a8-48ce-83a7-bc05f5a62b8d/istio-proxy/0.log" Jul 12 22:00:17.900090 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:17.900059 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lpp8d_3fb436b7-4e49-4c2b-a983-85f268685160/istio-proxy/0.log" Jul 12 22:00:18.212294 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:18.212256 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lpp8d_3fb436b7-4e49-4c2b-a983-85f268685160/istio-proxy/1.log" Jul 12 22:00:18.532918 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:18.532826 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69989bc466-hccm4_7f454bec-abd1-482e-8365-fc313f9f18bf/manager/0.log" Jul 12 22:00:18.593517 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:18.593473 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rn6nw_901b355b-68ae-4939-9f4a-0e9a11e82f87/openshift-lws-operator/0.log" Jul 12 22:00:19.433354 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:19.433313 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p66kh_4536f46a-92a8-48ce-83a7-bc05f5a62b8d/istio-proxy/0.log" Jul 12 22:00:19.525128 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:19.525087 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lpp8d_3fb436b7-4e49-4c2b-a983-85f268685160/istio-proxy/0.log" Jul 12 22:00:19.847081 ip-10-0-128-127 kubenswrapper[2573]: I0712 22:00:19.847047 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lpp8d_3fb436b7-4e49-4c2b-a983-85f268685160/istio-proxy/1.log"