Jul 22 01:44:40.322039 ip-10-0-141-12 systemd[1]: Starting Kubernetes Kubelet... Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.763809 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774396 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774412 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774416 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774419 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774423 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774427 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774431 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:44:40.852611 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774434 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:44:40.848031 ip-10-0-141-12 systemd[1]: Started Kubernetes Kubelet. Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774437 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774440 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774443 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774446 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774449 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774452 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774455 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774458 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774462 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774465 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774467 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774470 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774473 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774476 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774478 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774481 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774484 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774486 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:44:40.854320 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774489 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774497 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774500 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774502 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774506 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774508 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774511 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774513 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774516 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774519 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774521 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774524 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774526 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774529 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774532 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774535 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774537 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774540 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774543 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774545 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:44:40.856277 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774548 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774551 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774554 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774557 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774561 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774564 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774566 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774569 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774572 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774575 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774577 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774580 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774582 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774585 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774588 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774590 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774593 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774596 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774599 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:44:40.885397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774601 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774604 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774606 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774609 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774611 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774614 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774616 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774623 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774627 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774631 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774633 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774636 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774639 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774641 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774644 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774647 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774650 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774653 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774656 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774658 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:44:40.888253 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774661 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774664 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774668 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774672 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774675 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774678 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774680 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774683 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774685 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774688 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774690 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774693 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774695 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.774698 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775474 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775482 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775486 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775489 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775491 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775494 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:44:40.890883 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775498 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775501 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775504 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775507 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775509 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775513 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775516 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775519 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775522 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775524 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775527 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775531 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775533 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775536 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775538 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775541 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775544 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775548 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775552 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:44:40.893342 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775554 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775559 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775563 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775567 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775570 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775573 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775576 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775579 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775581 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775584 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775588 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775592 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775595 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775598 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775601 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775604 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775607 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775610 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775612 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:44:40.895340 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775615 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775618 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775620 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775623 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775626 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775629 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775632 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775635 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775637 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775640 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775643 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775646 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775648 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775651 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775654 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775656 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775659 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775661 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775664 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775667 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:44:40.896213 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775669 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775674 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775677 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775680 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775683 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775686 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775688 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775691 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775693 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775695 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775699 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775702 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775704 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775707 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775709 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775712 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775715 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775717 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775720 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:44:40.935477 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775722 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775725 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775728 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775730 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775733 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775735 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775737 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775754 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775757 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775759 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775762 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775764 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775767 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775769 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775774 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.775777 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776150 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776155 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776158 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776160 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:44:41.073275 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776163 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776165 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776168 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776171 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776173 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776176 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776179 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776181 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776184 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776186 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776189 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776193 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776197 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776200 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776203 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776208 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776211 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776214 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776217 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:44:41.075446 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776220 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776222 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776225 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776227 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776229 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776232 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776235 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776238 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776241 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776243 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776246 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776249 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776251 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776254 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776256 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776259 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776261 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776265 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776268 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:44:41.077809 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776271 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776274 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776276 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776278 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776281 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776283 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776285 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776289 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776291 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776295 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776298 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776300 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776303 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776305 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776308 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776311 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776313 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776317 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776319 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776322 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:44:41.078597 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776325 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776328 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776330 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776333 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776335 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776338 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776341 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776343 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776346 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776348 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776351 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776353 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776356 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776358 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776376 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776379 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776383 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776387 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776391 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776394 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:44:41.079199 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776397 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776401 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776403 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776406 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776408 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776411 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776414 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776416 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776419 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776421 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776424 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776426 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776430 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776433 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776435 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776438 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.776440 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776504 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776511 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776517 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776521 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 01:44:41.079764 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776525 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776528 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776532 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776536 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776539 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776542 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776545 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776549 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776552 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776554 2579 flags.go:64] FLAG: --cgroup-root="" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776557 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776560 2579 flags.go:64] FLAG: --client-ca-file="" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776565 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776568 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776573 2579 flags.go:64] FLAG: --cluster-domain="" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776576 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776579 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776582 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776585 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776589 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776592 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776594 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776598 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776602 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 22 01:44:41.080362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776605 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776608 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776611 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776614 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776618 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776622 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776625 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776627 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776630 2579 flags.go:64] FLAG: --enable-server="true" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776633 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776637 2579 flags.go:64] FLAG: --event-burst="100" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776640 2579 flags.go:64] FLAG: --event-qps="50" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776643 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776646 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776648 2579 flags.go:64] FLAG: --eviction-hard="" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776652 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776655 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776658 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776661 2579 flags.go:64] FLAG: --eviction-soft="" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776664 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776668 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776671 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776674 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776677 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776680 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 01:44:41.081000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776683 2579 flags.go:64] FLAG: --feature-gates="" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776687 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776690 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776692 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776695 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776698 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776703 2579 flags.go:64] FLAG: --help="false" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776706 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776709 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776711 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776714 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776717 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776721 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776724 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776727 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776729 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776732 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776735 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776738 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776757 2579 flags.go:64] FLAG: --kube-reserved="" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776760 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776763 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776766 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776769 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 01:44:41.081777 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776772 2579 flags.go:64] FLAG: --lock-file="" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776774 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776778 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776782 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776788 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776791 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776794 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776797 2579 flags.go:64] FLAG: --logging-format="text" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776800 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776803 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776806 2579 flags.go:64] FLAG: --manifest-url="" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776809 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776813 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776816 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776821 2579 flags.go:64] FLAG: --max-pods="110" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776824 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776827 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776830 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776833 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776836 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776839 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776841 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776848 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776851 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776854 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 01:44:41.082782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776857 2579 flags.go:64] FLAG: --pod-cidr="" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776860 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776866 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776868 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776871 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776874 2579 flags.go:64] FLAG: --port="10250" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776877 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776880 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06db14290e71f74a3" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776883 2579 flags.go:64] FLAG: --qos-reserved="" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776887 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776889 2579 flags.go:64] FLAG: --register-node="true" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776894 2579 flags.go:64] FLAG: --register-with-taints="" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776898 2579 flags.go:64] FLAG: --registry-burst="10" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776904 2579 flags.go:64] FLAG: --registry-qps="5" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776909 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776913 2579 flags.go:64] FLAG: --reserved-memory="" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776919 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776923 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776928 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776932 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776935 2579 flags.go:64] FLAG: --runonce="false" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776940 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776944 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776947 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776949 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 01:44:41.083542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776952 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776955 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776958 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776961 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776964 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776967 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776970 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776973 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776975 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776978 2579 flags.go:64] FLAG: --system-cgroups="" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776982 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776987 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776990 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776992 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.776997 2579 flags.go:64] FLAG: --tls-min-version="" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777000 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777003 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777005 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777010 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777013 2579 flags.go:64] FLAG: --v="2" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777017 2579 flags.go:64] FLAG: --version="false" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777021 2579 flags.go:64] FLAG: --vmodule="" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777025 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.777028 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 01:44:41.204405 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777156 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777160 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777163 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777166 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777171 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777174 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777177 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777180 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777183 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777187 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777191 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777194 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777197 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777200 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777203 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777206 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777209 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777212 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777215 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:44:41.205563 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777217 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777220 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777223 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777226 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777229 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777231 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777234 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777238 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777241 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777244 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777246 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777249 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777252 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777255 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777257 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777260 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777262 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777266 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777269 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777271 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:44:41.206349 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777274 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777276 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777280 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777284 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777287 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777289 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777292 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777294 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777297 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777299 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777302 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777304 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777307 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777309 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777312 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777315 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777317 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777320 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777322 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:44:41.207137 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777326 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777330 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777333 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777336 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777339 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777342 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777345 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777347 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777350 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777352 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777356 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777359 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777361 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777364 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777366 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777369 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777371 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777374 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777376 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:44:41.207961 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777379 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777381 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777384 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777386 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777389 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777391 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777394 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777396 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777399 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777402 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777404 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777406 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777409 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777413 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777415 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777418 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777420 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777423 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777425 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777429 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:44:41.208793 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777431 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.777434 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.778192 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.785512 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.785530 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.785547 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.785553 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785611 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785616 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785619 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785622 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785625 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785627 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785630 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785633 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:44:41.209591 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785635 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785638 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785641 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785644 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785646 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785649 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785651 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785654 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785656 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785659 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785664 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785666 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785671 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785673 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785676 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785680 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785684 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785687 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785689 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:44:41.210420 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785692 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785694 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785698 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785700 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785703 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785705 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785708 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785712 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785715 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785719 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785722 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785724 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785727 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785730 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785732 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785735 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785738 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785753 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785756 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:44:41.211240 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785758 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785761 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785763 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785766 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785770 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785773 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785776 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785779 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785781 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785784 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785787 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785789 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785792 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785795 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785797 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785800 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785806 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785808 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785811 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785814 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:44:41.212062 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785816 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785819 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785821 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785824 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785826 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785829 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785831 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785834 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785837 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785839 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785843 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785847 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785849 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785852 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785855 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785857 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785862 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785864 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785868 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:44:41.212881 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785871 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785873 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785876 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785878 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785881 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785884 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785886 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785889 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785891 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785894 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785897 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785900 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785903 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.785905 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.785910 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:44:41.213666 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786043 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786047 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786050 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786054 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786057 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786059 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786062 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786064 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786067 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786070 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786072 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786075 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786077 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786080 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786083 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786086 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786089 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786092 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786095 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786097 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:44:41.214475 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786101 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786103 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786106 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786108 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786111 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786114 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786116 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786119 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786122 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786124 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786127 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786130 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786132 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786135 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786138 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786141 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786144 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786147 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786149 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786152 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:44:41.215290 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786154 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786157 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786159 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786162 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786164 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786166 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786171 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786173 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786176 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786179 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786182 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786184 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786187 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786190 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786192 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786195 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786197 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786200 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786202 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786205 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:44:41.216099 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786207 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786216 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786219 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786221 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786224 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786226 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786230 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786233 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786236 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786240 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786243 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786245 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786248 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786251 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786254 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786256 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786259 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786261 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786265 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:44:41.216928 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786267 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786270 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786274 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786277 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786280 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786282 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786286 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786289 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786292 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786295 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786298 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786300 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786303 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786305 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786308 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786316 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786319 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786321 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786324 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:44:41.217731 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:40.786326 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.786331 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.786438 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.789541 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.791293 2579 server.go:1019] "Starting client certificate rotation" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.791388 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.791424 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.794071 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.796005 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.808398 2579 log.go:25] "Validated CRI v1 runtime API" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.811635 2579 log.go:25] "Validated CRI v1 image API" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.812812 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 01:44:41.218541 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.816343 2579 fs.go:135] Filesystem UUIDs: map[239e1988-14cd-4d94-bb0c-577dbde3d75e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cf2f7afb-3cce-4cd5-b829-5c716bc447ea:/dev/nvme0n1p3] Jul 22 01:44:41.218952 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.816361 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.823752 2579 manager.go:216] Machine: {Timestamp:2026-07-22 01:44:40.822357966 +0000 UTC m=+0.373571674 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100187 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2984fca4383bcab44dabdd9658b3f3 SystemUUID:ec2984fc-a438-3bca-b44d-abdd9658b3f3 BootID:36a06c60-7957-4b50-bf9a-f438ed4d2100 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:78:5e:15:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:78:5e:15:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:94:1d:f8:8b:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.823863 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.823946 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.827510 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.827541 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.828413 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.828424 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 01:44:41.219364 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.828432 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.829342 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.831269 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.831685 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.835945 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836052 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836075 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836084 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836099 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836107 2579 kubelet.go:398] "Adding apiserver pod source" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836116 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836393 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.836408 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.838681 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.841198 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.841224 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842633 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842652 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842666 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842672 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842681 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842689 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842697 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842702 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842710 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842718 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842761 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.842770 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.843632 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.843651 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.847142 2579 server.go:1268] "Started kubelet" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.847254 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.847351 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.847350 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.847769 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.847777 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.847915 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.849120 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.850004 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 22 01:44:41.223359 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.856113 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.856154 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-12.ec2.internal.18c47942f5f90afe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-12.ec2.internal,UID:ip-10-0-141-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-12.ec2.internal,},FirstTimestamp:2026-07-22 01:44:40.84710067 +0000 UTC m=+0.398314375,LastTimestamp:2026-07-22 01:44:40.84710067 +0000 UTC m=+0.398314375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-12.ec2.internal,}" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.858429 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.858443 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.858530 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.859160 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.859163 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.859182 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.859296 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.859304 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.859879 2579 factory.go:55] Registering systemd factory Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.859891 2579 factory.go:223] Registration of the systemd container factory successfully Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.860070 2579 factory.go:153] Registering CRI-O factory Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.860084 2579 factory.go:223] Registration of the crio container factory successfully Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.860130 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.860151 2579 factory.go:103] Registering Raw factory Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.860169 2579 manager.go:1196] Started watching for new ooms in manager Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.860552 2579 manager.go:349] Starting recovery of all containers Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.860586 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.860995 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.872663 2579 manager.go:354] Recovery completed Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.877450 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.879638 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.879664 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.879709 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.879874 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9s9hc" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.880228 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.880239 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.880257 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.880256 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.881335 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.881353 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.881362 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:44:41.224565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.886282 2579 policy_none.go:49] "None policy: Start" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.886295 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.886305 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.888206 2579 policy_none.go:47] "Start" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.890190 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-12.ec2.internal.18c47942f7e9b9ab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-12.ec2.internal,UID:ip-10-0-141-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-12.ec2.internal,},FirstTimestamp:2026-07-22 01:44:40.879651243 +0000 UTC m=+0.430864946,LastTimestamp:2026-07-22 01:44:40.879651243 +0000 UTC m=+0.430864946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-12.ec2.internal,}" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.890416 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9s9hc" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.892680 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-12.ec2.internal.18c47942f7ea05cf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-12.ec2.internal,UID:ip-10-0-141-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-12.ec2.internal,},FirstTimestamp:2026-07-22 01:44:40.879670735 +0000 UTC m=+0.430884439,LastTimestamp:2026-07-22 01:44:40.879670735 +0000 UTC m=+0.430884439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-12.ec2.internal,}" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.958801 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.960253 2579 manager.go:337] "Starting Device Plugin manager" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.960281 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.960292 2579 server.go:87] "Starting device plugin registration server" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.960566 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.960579 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.960706 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.960795 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.960804 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.961214 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.961265 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.962833 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.964106 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.964148 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.964170 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:40.964207 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:40.966727 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.061234 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.062295 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.062358 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:44:41.333306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.062374 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.062397 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.064259 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal"] Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.064317 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.067162 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-12.ec2.internal\" not found" node="ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.067730 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.067769 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.067781 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.070058 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.070162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.070190 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.070723 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.070765 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.070779 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.071237 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.071263 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.071278 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.072476 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.072495 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-12.ec2.internal\": node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.072994 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.073014 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.073836 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.073869 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.073883 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.098449 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.151850 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-12.ec2.internal\" not found" node="ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.156166 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-12.ec2.internal\" not found" node="ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.160321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc02d073e845739ff107ec54f6a26bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal\" (UID: \"2dc02d073e845739ff107ec54f6a26bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.334522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.160343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f8524ca7c47e8bba520d13ce2994f71-config\") pod \"kube-apiserver-proxy-ip-10-0-141-12.ec2.internal\" (UID: \"8f8524ca7c47e8bba520d13ce2994f71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.160358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dc02d073e845739ff107ec54f6a26bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal\" (UID: \"2dc02d073e845739ff107ec54f6a26bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.198919 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.261308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dc02d073e845739ff107ec54f6a26bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal\" (UID: \"2dc02d073e845739ff107ec54f6a26bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.261328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dc02d073e845739ff107ec54f6a26bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal\" (UID: \"2dc02d073e845739ff107ec54f6a26bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.261379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc02d073e845739ff107ec54f6a26bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal\" (UID: \"2dc02d073e845739ff107ec54f6a26bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.261400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f8524ca7c47e8bba520d13ce2994f71-config\") pod \"kube-apiserver-proxy-ip-10-0-141-12.ec2.internal\" (UID: \"8f8524ca7c47e8bba520d13ce2994f71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.261435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f8524ca7c47e8bba520d13ce2994f71-config\") pod \"kube-apiserver-proxy-ip-10-0-141-12.ec2.internal\" (UID: \"8f8524ca7c47e8bba520d13ce2994f71\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.261456 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc02d073e845739ff107ec54f6a26bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal\" (UID: \"2dc02d073e845739ff107ec54f6a26bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.335349 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.299487 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.457099 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.400162 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.457099 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.455343 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.459610 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.458774 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.570377 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.500848 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.684067 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.601323 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-12.ec2.internal\" not found" Jul 22 01:44:41.692273 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.691336 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:44:41.817689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.758940 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.817689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.769805 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:44:41.817689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.771381 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" Jul 22 01:44:41.817689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.788510 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:44:41.817689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.790781 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 01:44:41.817689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.790892 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 01:44:41.817689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.790944 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.837103 2579 apiserver.go:52] "Watching apiserver" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.858134 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.858539 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.858539 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-hflfz","openshift-dns/node-resolver-52w6n","openshift-image-registry/node-ca-9phhl","openshift-multus/multus-additional-cni-plugins-58n2m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal","openshift-multus/multus-t9wf5","openshift-multus/network-metrics-daemon-4mwsg","openshift-network-diagnostics/network-check-target-vdw2x","openshift-network-operator/iptables-alerter-d7z4k","openshift-ovn-kubernetes/ovnkube-node-6gzvl","kube-system/global-pull-secret-syncer-w6zb4","kube-system/konnectivity-agent-wmhts","kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm"] Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.861210 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.861290 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.863501 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.864600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.864631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs2cr\" (UniqueName: \"kubernetes.io/projected/aa670b94-03c6-4342-95f9-f0d4e6737ebd-kube-api-access-gs2cr\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.865660 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.865715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.865805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.865669 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6xmts\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.866015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.866079 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.868258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.870628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.871126 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mclr9\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.871133 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.871175 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.871350 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.871384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 01:44:41.959487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.871384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.871657 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.872908 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.873008 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.873649 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.874826 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v4brs\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.875504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.875644 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pwlwk\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.875727 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.877614 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.877714 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.877963 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qqgh5\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.878045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.880057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.880336 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.880439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.880499 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.880636 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.881050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.881102 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gcfkq\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.881357 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.881395 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.882940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.885348 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.887760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890045 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890431 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9th8c\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890441 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890470 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890479 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wbsj4\"" Jul 22 01:44:41.961868 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890508 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-799wc\"" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890679 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.890788 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.891218 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.891410 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.896312 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 01:39:41 +0000 UTC" deadline="2028-01-27 10:24:31.171470561 +0000 UTC" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.896341 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13304h39m49.275132956s" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.921786 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh94p" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.929919 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh94p" Jul 22 01:44:41.962809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.960418 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17ffc3c7-6fca-4338-9743-09f062360a3b-host-slash\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fffdz\" (UniqueName: \"kubernetes.io/projected/17ffc3c7-6fca-4338-9743-09f062360a3b-kube-api-access-fffdz\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-cnibin\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965213 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-k8s-cni-cncf-io\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-modprobe-d\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-cni-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvff\" (UniqueName: \"kubernetes.io/projected/e3a2f968-04fe-417e-a9bc-92ab4f939906-kube-api-access-lsvff\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-run-netns\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae640e3-9062-4185-a55a-6048287c5ff3-agent-certs\") pod \"konnectivity-agent-wmhts\" (UID: \"6ae640e3-9062-4185-a55a-6048287c5ff3\") " pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgchx\" (UniqueName: \"kubernetes.io/projected/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-kube-api-access-lgchx\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-socket-dir-parent\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1576cc62-f732-4d31-8e89-959676e51c35-tmp\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.971482 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxksk\" (UniqueName: \"kubernetes.io/projected/1576cc62-f732-4d31-8e89-959676e51c35-kube-api-access-jxksk\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3a2f968-04fe-417e-a9bc-92ab4f939906-cni-binary-copy\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovnkube-script-lib\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-hosts-file\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-registration-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-sys-fs\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-system-cni-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-daemon-config\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-etc-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-socket-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.972408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/832d1177-661d-466e-813c-1edcaff38e0b-host\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17ffc3c7-6fca-4338-9743-09f062360a3b-iptables-alerter-script\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysconfig\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-sys\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-conf-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.965984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-var-lib-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-kubernetes\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysctl-conf\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-systemd\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1576cc62-f732-4d31-8e89-959676e51c35-etc-tuned\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.974335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-node-log\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-cni-bin\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2412d691-73e5-4f34-a229-5b037e35536c-dbus\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-system-cni-dir\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-os-release\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-systemd-units\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovnkube-config\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysctl-d\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-run\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-hostroot\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cnibin\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-log-socket\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:41.974836 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-var-lib-kubelet\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.966627 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-host\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-slash\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:41.966763 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs podName:aa670b94-03c6-4342-95f9-f0d4e6737ebd nodeName:}" failed. No retries permitted until 2026-07-22 01:44:42.466719337 +0000 UTC m=+2.017933029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs") pod "network-metrics-daemon-4mwsg" (UID: "aa670b94-03c6-4342-95f9-f0d4e6737ebd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-env-overrides\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/832d1177-661d-466e-813c-1edcaff38e0b-serviceca\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-multus-certs\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8mrf\" (UniqueName: \"kubernetes.io/projected/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-kube-api-access-l8mrf\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966866 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xjr4\" (UniqueName: \"kubernetes.io/projected/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-kube-api-access-8xjr4\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae640e3-9062-4185-a55a-6048287c5ff3-konnectivity-ca\") pod \"konnectivity-agent-wmhts\" (UID: \"6ae640e3-9062-4185-a55a-6048287c5ff3\") " pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-device-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:41.975321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-cni-bin\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-cni-multus\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.966989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-kubelet\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-ovn\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs2cr\" (UniqueName: \"kubernetes.io/projected/aa670b94-03c6-4342-95f9-f0d4e6737ebd-kube-api-access-gs2cr\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-netns\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-tmp-dir\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2412d691-73e5-4f34-a229-5b037e35536c-kubelet-config\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-kubelet\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-systemd\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-cni-netd\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovn-node-metrics-cert\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967354 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-lib-modules\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:41.978724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-etc-kubernetes\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.979669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8pb\" (UniqueName: \"kubernetes.io/projected/832d1177-661d-466e-813c-1edcaff38e0b-kube-api-access-gh8pb\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:41.979669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-os-release\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:41.979669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.967476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hght8\" (UniqueName: \"kubernetes.io/projected/0cd82753-62c6-44a4-a650-55aaf0c4914f-kube-api-access-hght8\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:41.979669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.978698 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:41.985011 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs2cr\" (UniqueName: \"kubernetes.io/projected/aa670b94-03c6-4342-95f9-f0d4e6737ebd-kube-api-access-gs2cr\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.064620 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-node-log\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-cni-bin\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2412d691-73e5-4f34-a229-5b037e35536c-dbus\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-node-log\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068629 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-cni-bin\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-system-cni-dir\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-os-release\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-systemd-units\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2412d691-73e5-4f34-a229-5b037e35536c-dbus\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068727 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-system-cni-dir\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.097231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068767 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-systemd-units\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068768 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-os-release\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovnkube-config\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysctl-d\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-run\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-hostroot\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cnibin\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-run\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-log-socket\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-hostroot\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-var-lib-kubelet\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068957 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysctl-d\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cnibin\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.068977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-host\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.099597 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069005 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-log-socket\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-slash\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069019 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-var-lib-kubelet\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-host\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069043 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-slash\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-env-overrides\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069075 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/832d1177-661d-466e-813c-1edcaff38e0b-serviceca\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-multus-certs\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8mrf\" (UniqueName: \"kubernetes.io/projected/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-kube-api-access-l8mrf\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069141 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-multus-certs\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xjr4\" (UniqueName: \"kubernetes.io/projected/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-kube-api-access-8xjr4\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae640e3-9062-4185-a55a-6048287c5ff3-konnectivity-ca\") pod \"konnectivity-agent-wmhts\" (UID: \"6ae640e3-9062-4185-a55a-6048287c5ff3\") " pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-device-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-cni-bin\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.100568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-cni-multus\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-kubelet\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-device-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-ovn\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-netns\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-tmp-dir\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-kubelet\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2412d691-73e5-4f34-a229-5b037e35536c-kubelet-config\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-kubelet\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069461 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-cni-multus\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-systemd\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069471 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-netns\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-cni-netd\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2412d691-73e5-4f34-a229-5b037e35536c-kubelet-config\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:42.101079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069438 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-var-lib-cni-bin\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-ovn\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovn-node-metrics-cert\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-kubelet\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-lib-modules\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-etc-kubernetes\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069629 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-systemd\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8pb\" (UniqueName: \"kubernetes.io/projected/832d1177-661d-466e-813c-1edcaff38e0b-kube-api-access-gh8pb\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-etc-kubernetes\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-os-release\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069741 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-lib-modules\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069773 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-cni-netd\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hght8\" (UniqueName: \"kubernetes.io/projected/0cd82753-62c6-44a4-a650-55aaf0c4914f-kube-api-access-hght8\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-os-release\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17ffc3c7-6fca-4338-9743-09f062360a3b-host-slash\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:42.102039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.069989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fffdz\" (UniqueName: \"kubernetes.io/projected/17ffc3c7-6fca-4338-9743-09f062360a3b-kube-api-access-fffdz\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17ffc3c7-6fca-4338-9743-09f062360a3b-host-slash\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-cnibin\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-k8s-cni-cncf-io\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070108 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-host-run-k8s-cni-cncf-io\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070121 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-cnibin\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-modprobe-d\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-run-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-cni-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvff\" (UniqueName: \"kubernetes.io/projected/e3a2f968-04fe-417e-a9bc-92ab4f939906-kube-api-access-lsvff\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-run-netns\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae640e3-9062-4185-a55a-6048287c5ff3-agent-certs\") pod \"konnectivity-agent-wmhts\" (UID: \"6ae640e3-9062-4185-a55a-6048287c5ff3\") " pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgchx\" (UniqueName: \"kubernetes.io/projected/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-kube-api-access-lgchx\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.103456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-modprobe-d\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-socket-dir-parent\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070288 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-cni-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070357 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-run-netns\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1576cc62-f732-4d31-8e89-959676e51c35-tmp\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxksk\" (UniqueName: \"kubernetes.io/projected/1576cc62-f732-4d31-8e89-959676e51c35-kube-api-access-jxksk\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3a2f968-04fe-417e-a9bc-92ab4f939906-cni-binary-copy\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovnkube-script-lib\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-hosts-file\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-registration-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-socket-dir-parent\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.104426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-sys-fs\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-hosts-file\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-sys-fs\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-system-cni-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-daemon-config\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-etc-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-system-cni-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-socket-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/832d1177-661d-466e-813c-1edcaff38e0b-host\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17ffc3c7-6fca-4338-9743-09f062360a3b-iptables-alerter-script\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysconfig\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.070990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-sys\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.104911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-conf-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-var-lib-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-kubernetes\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysctl-conf\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-systemd\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1576cc62-f732-4d31-8e89-959676e51c35-etc-tuned\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071190 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/832d1177-661d-466e-813c-1edcaff38e0b-host\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-conf-dir\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071434 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071517 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-registration-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysconfig\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.105396 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.071670 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-sys\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-etc-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.071976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-socket-dir\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-kubernetes\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-tmp-dir\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072294 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-sysctl-conf\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072334 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cd82753-62c6-44a4-a650-55aaf0c4914f-var-lib-openvswitch\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.072350 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret podName:2412d691-73e5-4f34-a229-5b037e35536c nodeName:}" failed. No retries permitted until 2026-07-22 01:44:42.572331174 +0000 UTC m=+2.123544890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret") pod "global-pull-secret-syncer-w6zb4" (UID: "2412d691-73e5-4f34-a229-5b037e35536c") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovnkube-config\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1576cc62-f732-4d31-8e89-959676e51c35-etc-systemd\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/832d1177-661d-466e-813c-1edcaff38e0b-serviceca\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:42.105884 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae640e3-9062-4185-a55a-6048287c5ff3-konnectivity-ca\") pod \"konnectivity-agent-wmhts\" (UID: \"6ae640e3-9062-4185-a55a-6048287c5ff3\") " pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.072864 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-env-overrides\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.073579 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovnkube-script-lib\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.073592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17ffc3c7-6fca-4338-9743-09f062360a3b-iptables-alerter-script\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.073977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3a2f968-04fe-417e-a9bc-92ab4f939906-multus-daemon-config\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.073985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3a2f968-04fe-417e-a9bc-92ab4f939906-cni-binary-copy\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.074844 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cd82753-62c6-44a4-a650-55aaf0c4914f-ovn-node-metrics-cert\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.075025 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae640e3-9062-4185-a55a-6048287c5ff3-agent-certs\") pod \"konnectivity-agent-wmhts\" (UID: \"6ae640e3-9062-4185-a55a-6048287c5ff3\") " pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.075151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1576cc62-f732-4d31-8e89-959676e51c35-tmp\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.075717 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1576cc62-f732-4d31-8e89-959676e51c35-etc-tuned\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.076677 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.076695 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.076705 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2j48q for pod openshift-network-diagnostics/network-check-target-vdw2x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.076753 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q podName:027fc867-c3e5-4706-b75f-e4246eb1f148 nodeName:}" failed. No retries permitted until 2026-07-22 01:44:42.576740567 +0000 UTC m=+2.127954263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2j48q" (UniqueName: "kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q") pod "network-check-target-vdw2x" (UID: "027fc867-c3e5-4706-b75f-e4246eb1f148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:42.106837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.079537 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxksk\" (UniqueName: \"kubernetes.io/projected/1576cc62-f732-4d31-8e89-959676e51c35-kube-api-access-jxksk\") pod \"tuned-hflfz\" (UID: \"1576cc62-f732-4d31-8e89-959676e51c35\") " pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:42.107329 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.081695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvff\" (UniqueName: \"kubernetes.io/projected/e3a2f968-04fe-417e-a9bc-92ab4f939906-kube-api-access-lsvff\") pod \"multus-t9wf5\" (UID: \"e3a2f968-04fe-417e-a9bc-92ab4f939906\") " pod="openshift-multus/multus-t9wf5" Jul 22 01:44:42.107329 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.082241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hght8\" (UniqueName: \"kubernetes.io/projected/0cd82753-62c6-44a4-a650-55aaf0c4914f-kube-api-access-hght8\") pod \"ovnkube-node-6gzvl\" (UID: \"0cd82753-62c6-44a4-a650-55aaf0c4914f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:42.107329 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.082324 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgchx\" (UniqueName: \"kubernetes.io/projected/efae65a2-ecec-4ff9-9e24-3c86c7d9a26d-kube-api-access-lgchx\") pod \"aws-ebs-csi-driver-node-xlwxm\" (UID: \"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:42.107329 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.082600 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8mrf\" (UniqueName: \"kubernetes.io/projected/f919c0f1-1f3a-4be2-ab81-6daeb2435c0e-kube-api-access-l8mrf\") pod \"node-resolver-52w6n\" (UID: \"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e\") " pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:42.107329 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.082688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xjr4\" (UniqueName: \"kubernetes.io/projected/d673ede1-f8bf-4f04-bd37-2bfb9cac29ec-kube-api-access-8xjr4\") pod \"multus-additional-cni-plugins-58n2m\" (UID: \"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec\") " pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:42.107329 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.085969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fffdz\" (UniqueName: \"kubernetes.io/projected/17ffc3c7-6fca-4338-9743-09f062360a3b-kube-api-access-fffdz\") pod \"iptables-alerter-d7z4k\" (UID: \"17ffc3c7-6fca-4338-9743-09f062360a3b\") " pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:42.107329 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.086030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8pb\" (UniqueName: \"kubernetes.io/projected/832d1177-661d-466e-813c-1edcaff38e0b-kube-api-access-gh8pb\") pod \"node-ca-9phhl\" (UID: \"832d1177-661d-466e-813c-1edcaff38e0b\") " pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:42.235492 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.122469 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:44:42.503475 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.474000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:42.503475 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.474094 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:42.503475 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.474148 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs podName:aa670b94-03c6-4342-95f9-f0d4e6737ebd nodeName:}" failed. No retries permitted until 2026-07-22 01:44:43.474133764 +0000 UTC m=+3.025347456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs") pod "network-metrics-daemon-4mwsg" (UID: "aa670b94-03c6-4342-95f9-f0d4e6737ebd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:42.636773 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.574227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:42.636773 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.574369 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:42.636773 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.574428 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret podName:2412d691-73e5-4f34-a229-5b037e35536c nodeName:}" failed. No retries permitted until 2026-07-22 01:44:43.574412047 +0000 UTC m=+3.125625739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret") pod "global-pull-secret-syncer-w6zb4" (UID: "2412d691-73e5-4f34-a229-5b037e35536c") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:42.773229 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.675246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:42.773229 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.675365 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:44:42.773229 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.675379 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:44:42.773229 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.675389 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2j48q for pod openshift-network-diagnostics/network-check-target-vdw2x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:42.773229 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.675438 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q podName:027fc867-c3e5-4706-b75f-e4246eb1f148 nodeName:}" failed. No retries permitted until 2026-07-22 01:44:43.675423319 +0000 UTC m=+3.226637013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2j48q" (UniqueName: "kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q") pod "network-check-target-vdw2x" (UID: "027fc867-c3e5-4706-b75f-e4246eb1f148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:43.024629 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.933783 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:39:42 +0000 UTC" deadline="2028-02-07 01:27:54.374965086 +0000 UTC" Jul 22 01:44:43.024629 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.933808 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13559h43m11.441160107s" Jul 22 01:44:43.024629 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:42.965289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:43.024629 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:42.965413 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:43.192628 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.192605 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:44:43.199087 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.199067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7z4k" Jul 22 01:44:43.213421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.213397 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58n2m" Jul 22 01:44:43.229496 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.229479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hflfz" Jul 22 01:44:43.242640 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.242617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9wf5" Jul 22 01:44:43.259309 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.259291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52w6n" Jul 22 01:44:43.267912 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.267869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:44:43.294423 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.294407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:44:43.307614 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.307592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9phhl" Jul 22 01:44:43.312653 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.312634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" Jul 22 01:44:43.378154 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.378117 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8524ca7c47e8bba520d13ce2994f71.slice/crio-3a4020d270867bd9f8dbfb7628aac28c764f3e76d4c1e008d957793b1dab3d32 WatchSource:0}: Error finding container 3a4020d270867bd9f8dbfb7628aac28c764f3e76d4c1e008d957793b1dab3d32: Status 404 returned error can't find the container with id 3a4020d270867bd9f8dbfb7628aac28c764f3e76d4c1e008d957793b1dab3d32 Jul 22 01:44:43.386313 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.386298 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:44:43.481014 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.480931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:43.481154 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.481087 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:43.481154 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.481148 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs podName:aa670b94-03c6-4342-95f9-f0d4e6737ebd nodeName:}" failed. No retries permitted until 2026-07-22 01:44:45.48113254 +0000 UTC m=+5.032346237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs") pod "network-metrics-daemon-4mwsg" (UID: "aa670b94-03c6-4342-95f9-f0d4e6737ebd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:43.545711 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.545683 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc02d073e845739ff107ec54f6a26bb.slice/crio-72f1a71c821bf7253bcd2432eff8650eaebfcadd449bd0d02dfc08a8d547e4ca WatchSource:0}: Error finding container 72f1a71c821bf7253bcd2432eff8650eaebfcadd449bd0d02dfc08a8d547e4ca: Status 404 returned error can't find the container with id 72f1a71c821bf7253bcd2432eff8650eaebfcadd449bd0d02dfc08a8d547e4ca Jul 22 01:44:43.582321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.582295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:43.582474 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.582398 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:43.582474 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.582460 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret podName:2412d691-73e5-4f34-a229-5b037e35536c nodeName:}" failed. No retries permitted until 2026-07-22 01:44:45.582444287 +0000 UTC m=+5.133657980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret") pod "global-pull-secret-syncer-w6zb4" (UID: "2412d691-73e5-4f34-a229-5b037e35536c") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:43.591963 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.591933 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1576cc62_f732_4d31_8e89_959676e51c35.slice/crio-ceb05cd8c46eaa82c4f1a9bee90459032b814a975d872e6c066192ba26913eba WatchSource:0}: Error finding container ceb05cd8c46eaa82c4f1a9bee90459032b814a975d872e6c066192ba26913eba: Status 404 returned error can't find the container with id ceb05cd8c46eaa82c4f1a9bee90459032b814a975d872e6c066192ba26913eba Jul 22 01:44:43.633541 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.633502 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ffc3c7_6fca_4338_9743_09f062360a3b.slice/crio-998098653a5ce2150e8308117b823231061d10b4fc9b37b6d386ef20312caefe WatchSource:0}: Error finding container 998098653a5ce2150e8308117b823231061d10b4fc9b37b6d386ef20312caefe: Status 404 returned error can't find the container with id 998098653a5ce2150e8308117b823231061d10b4fc9b37b6d386ef20312caefe Jul 22 01:44:43.660606 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.660582 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd673ede1_f8bf_4f04_bd37_2bfb9cac29ec.slice/crio-813ba19afae032dde4187cf19e414fc6788c58c9e35242b3cbdec6993489a1e9 WatchSource:0}: Error finding container 813ba19afae032dde4187cf19e414fc6788c58c9e35242b3cbdec6993489a1e9: Status 404 returned error can't find the container with id 813ba19afae032dde4187cf19e414fc6788c58c9e35242b3cbdec6993489a1e9 Jul 22 01:44:43.668013 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.667985 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a2f968_04fe_417e_a9bc_92ab4f939906.slice/crio-2fa4d0a544f2a76f1cf1f570ceac75508ced046d7b7cea65b0c844be602facb9 WatchSource:0}: Error finding container 2fa4d0a544f2a76f1cf1f570ceac75508ced046d7b7cea65b0c844be602facb9: Status 404 returned error can't find the container with id 2fa4d0a544f2a76f1cf1f570ceac75508ced046d7b7cea65b0c844be602facb9 Jul 22 01:44:43.671158 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.671137 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd82753_62c6_44a4_a650_55aaf0c4914f.slice/crio-7383da38775322f3a7510a9c12e4c8fa5306791bc3c53f28e173ea7985d43d51 WatchSource:0}: Error finding container 7383da38775322f3a7510a9c12e4c8fa5306791bc3c53f28e173ea7985d43d51: Status 404 returned error can't find the container with id 7383da38775322f3a7510a9c12e4c8fa5306791bc3c53f28e173ea7985d43d51 Jul 22 01:44:43.674123 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.674025 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf919c0f1_1f3a_4be2_ab81_6daeb2435c0e.slice/crio-186c37ca66f4feab5eb1265b070cfc7dece04de75965ebbc1c550a600d2742d7 WatchSource:0}: Error finding container 186c37ca66f4feab5eb1265b070cfc7dece04de75965ebbc1c550a600d2742d7: Status 404 returned error can't find the container with id 186c37ca66f4feab5eb1265b070cfc7dece04de75965ebbc1c550a600d2742d7 Jul 22 01:44:43.683026 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.683000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:43.683147 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.683132 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:44:43.683193 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.683151 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:44:43.683193 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.683161 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2j48q for pod openshift-network-diagnostics/network-check-target-vdw2x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:43.683261 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.683229 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q podName:027fc867-c3e5-4706-b75f-e4246eb1f148 nodeName:}" failed. No retries permitted until 2026-07-22 01:44:45.683207363 +0000 UTC m=+5.234421078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2j48q" (UniqueName: "kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q") pod "network-check-target-vdw2x" (UID: "027fc867-c3e5-4706-b75f-e4246eb1f148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:43.726131 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.726107 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefae65a2_ecec_4ff9_9e24_3c86c7d9a26d.slice/crio-04cfec1c56e4101cc3b0b0030631d76988f25209beca7a5e1fe972d9b3bc91a5 WatchSource:0}: Error finding container 04cfec1c56e4101cc3b0b0030631d76988f25209beca7a5e1fe972d9b3bc91a5: Status 404 returned error can't find the container with id 04cfec1c56e4101cc3b0b0030631d76988f25209beca7a5e1fe972d9b3bc91a5 Jul 22 01:44:43.808568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.808495 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:44:43.820965 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.820940 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832d1177_661d_466e_813c_1edcaff38e0b.slice/crio-28eae313ab9d2e4e0e323c6ed769fe47308f37727c7330b02fde3703f0522759 WatchSource:0}: Error finding container 28eae313ab9d2e4e0e323c6ed769fe47308f37727c7330b02fde3703f0522759: Status 404 returned error can't find the container with id 28eae313ab9d2e4e0e323c6ed769fe47308f37727c7330b02fde3703f0522759 Jul 22 01:44:43.838066 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:44:43.838042 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae640e3_9062_4185_a55a_6048287c5ff3.slice/crio-245f759d842f3c8081693ff35f49bb89ba8265635f13559c5847894a0b60d274 WatchSource:0}: Error finding container 245f759d842f3c8081693ff35f49bb89ba8265635f13559c5847894a0b60d274: Status 404 returned error can't find the container with id 245f759d842f3c8081693ff35f49bb89ba8265635f13559c5847894a0b60d274 Jul 22 01:44:43.934973 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.934913 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:39:42 +0000 UTC" deadline="2027-12-21 23:31:52.957234601 +0000 UTC" Jul 22 01:44:43.934973 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.934967 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12429h47m9.022271362s" Jul 22 01:44:43.965360 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.965292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:43.965360 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.965332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:43.965591 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.965423 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:43.965663 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:43.965585 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:43.971086 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.971026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9phhl" event={"ID":"832d1177-661d-466e-813c-1edcaff38e0b","Type":"ContainerStarted","Data":"28eae313ab9d2e4e0e323c6ed769fe47308f37727c7330b02fde3703f0522759"} Jul 22 01:44:43.972425 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.972396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" event={"ID":"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d","Type":"ContainerStarted","Data":"04cfec1c56e4101cc3b0b0030631d76988f25209beca7a5e1fe972d9b3bc91a5"} Jul 22 01:44:43.973826 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.973802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52w6n" event={"ID":"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e","Type":"ContainerStarted","Data":"186c37ca66f4feab5eb1265b070cfc7dece04de75965ebbc1c550a600d2742d7"} Jul 22 01:44:43.975267 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.975238 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7z4k" event={"ID":"17ffc3c7-6fca-4338-9743-09f062360a3b","Type":"ContainerStarted","Data":"998098653a5ce2150e8308117b823231061d10b4fc9b37b6d386ef20312caefe"} Jul 22 01:44:43.976451 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.976430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hflfz" event={"ID":"1576cc62-f732-4d31-8e89-959676e51c35","Type":"ContainerStarted","Data":"ceb05cd8c46eaa82c4f1a9bee90459032b814a975d872e6c066192ba26913eba"} Jul 22 01:44:43.977719 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.977697 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" event={"ID":"2dc02d073e845739ff107ec54f6a26bb","Type":"ContainerStarted","Data":"72f1a71c821bf7253bcd2432eff8650eaebfcadd449bd0d02dfc08a8d547e4ca"} Jul 22 01:44:43.978954 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.978932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wmhts" event={"ID":"6ae640e3-9062-4185-a55a-6048287c5ff3","Type":"ContainerStarted","Data":"245f759d842f3c8081693ff35f49bb89ba8265635f13559c5847894a0b60d274"} Jul 22 01:44:43.980432 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.980401 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"7383da38775322f3a7510a9c12e4c8fa5306791bc3c53f28e173ea7985d43d51"} Jul 22 01:44:43.981635 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.981615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9wf5" event={"ID":"e3a2f968-04fe-417e-a9bc-92ab4f939906","Type":"ContainerStarted","Data":"2fa4d0a544f2a76f1cf1f570ceac75508ced046d7b7cea65b0c844be602facb9"} Jul 22 01:44:43.982838 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.982815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerStarted","Data":"813ba19afae032dde4187cf19e414fc6788c58c9e35242b3cbdec6993489a1e9"} Jul 22 01:44:43.984284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:43.984264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" event={"ID":"8f8524ca7c47e8bba520d13ce2994f71","Type":"ContainerStarted","Data":"3a4020d270867bd9f8dbfb7628aac28c764f3e76d4c1e008d957793b1dab3d32"} Jul 22 01:44:44.964983 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:44.964946 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:44.965805 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:44.965098 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:45.504870 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:45.504794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:45.505068 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.504988 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:45.505068 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.505056 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs podName:aa670b94-03c6-4342-95f9-f0d4e6737ebd nodeName:}" failed. No retries permitted until 2026-07-22 01:44:49.505035178 +0000 UTC m=+9.056248876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs") pod "network-metrics-daemon-4mwsg" (UID: "aa670b94-03c6-4342-95f9-f0d4e6737ebd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:45.605753 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:45.605477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:45.605753 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.605668 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:45.605753 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.605734 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret podName:2412d691-73e5-4f34-a229-5b037e35536c nodeName:}" failed. No retries permitted until 2026-07-22 01:44:49.605715748 +0000 UTC m=+9.156929456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret") pod "global-pull-secret-syncer-w6zb4" (UID: "2412d691-73e5-4f34-a229-5b037e35536c") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:45.706235 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:45.706193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:45.706455 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.706434 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:44:45.706532 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.706466 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:44:45.706532 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.706481 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2j48q for pod openshift-network-diagnostics/network-check-target-vdw2x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:45.706644 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.706553 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q podName:027fc867-c3e5-4706-b75f-e4246eb1f148 nodeName:}" failed. No retries permitted until 2026-07-22 01:44:49.706530102 +0000 UTC m=+9.257743801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2j48q" (UniqueName: "kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q") pod "network-check-target-vdw2x" (UID: "027fc867-c3e5-4706-b75f-e4246eb1f148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:45.965327 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:45.965294 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:45.965899 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.965455 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:45.965899 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:45.965869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:45.966028 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:45.965973 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:46.965470 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:46.965437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:46.965972 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:46.965585 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:47.965430 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:47.964907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:47.965430 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:47.965064 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:47.965430 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:47.965100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:47.965430 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:47.965221 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:48.968092 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:48.965975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:48.968092 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:48.966216 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:49.541962 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:49.541922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:49.542150 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.542128 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:49.542219 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.542202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs podName:aa670b94-03c6-4342-95f9-f0d4e6737ebd nodeName:}" failed. No retries permitted until 2026-07-22 01:44:57.542181966 +0000 UTC m=+17.093395661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs") pod "network-metrics-daemon-4mwsg" (UID: "aa670b94-03c6-4342-95f9-f0d4e6737ebd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:49.643362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:49.643328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:49.643559 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.643508 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:49.643637 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.643585 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret podName:2412d691-73e5-4f34-a229-5b037e35536c nodeName:}" failed. No retries permitted until 2026-07-22 01:44:57.643563225 +0000 UTC m=+17.194776939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret") pod "global-pull-secret-syncer-w6zb4" (UID: "2412d691-73e5-4f34-a229-5b037e35536c") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:49.744163 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:49.744076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:49.744307 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.744234 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:44:49.744307 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.744253 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:44:49.744307 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.744266 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2j48q for pod openshift-network-diagnostics/network-check-target-vdw2x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:49.744407 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.744324 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q podName:027fc867-c3e5-4706-b75f-e4246eb1f148 nodeName:}" failed. No retries permitted until 2026-07-22 01:44:57.744309955 +0000 UTC m=+17.295523648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2j48q" (UniqueName: "kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q") pod "network-check-target-vdw2x" (UID: "027fc867-c3e5-4706-b75f-e4246eb1f148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:49.965250 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:49.965214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:49.965446 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:49.965214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:49.965446 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.965367 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:49.965578 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:49.965506 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:50.966050 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:50.966017 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:50.966533 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:50.966123 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:51.965084 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:51.965052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:51.965243 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:51.965099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:51.965243 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:51.965197 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:51.965368 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:51.965307 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:52.965314 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:52.965275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:52.965805 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:52.965403 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:53.965332 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:53.965246 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:53.965804 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:53.965265 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:53.965804 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:53.965392 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:53.965804 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:53.965434 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:54.964602 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:54.964570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:54.964786 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:54.964678 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:55.964463 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:55.964437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:55.964794 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:55.964533 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:55.964794 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:55.964583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:55.964794 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:55.964674 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:56.965126 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:56.965091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:56.965585 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:56.965217 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:57.607553 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:57.607516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:57.607768 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.607667 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:57.607768 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.607737 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs podName:aa670b94-03c6-4342-95f9-f0d4e6737ebd nodeName:}" failed. No retries permitted until 2026-07-22 01:45:13.607719507 +0000 UTC m=+33.158933199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs") pod "network-metrics-daemon-4mwsg" (UID: "aa670b94-03c6-4342-95f9-f0d4e6737ebd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:44:57.708479 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:57.708436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:57.708665 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.708593 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:57.708665 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.708664 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret podName:2412d691-73e5-4f34-a229-5b037e35536c nodeName:}" failed. No retries permitted until 2026-07-22 01:45:13.708644906 +0000 UTC m=+33.259858597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret") pod "global-pull-secret-syncer-w6zb4" (UID: "2412d691-73e5-4f34-a229-5b037e35536c") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:44:57.809675 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:57.809639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:57.809856 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.809830 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:44:57.809856 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.809852 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:44:57.809966 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.809862 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2j48q for pod openshift-network-diagnostics/network-check-target-vdw2x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:57.809966 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.809915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q podName:027fc867-c3e5-4706-b75f-e4246eb1f148 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:13.809894991 +0000 UTC m=+33.361108693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2j48q" (UniqueName: "kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q") pod "network-check-target-vdw2x" (UID: "027fc867-c3e5-4706-b75f-e4246eb1f148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:44:57.965283 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:57.965201 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:57.965669 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.965317 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:57.965669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:57.965355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:57.965669 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:57.965417 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:44:58.964920 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:58.964887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:44:58.965116 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:58.965016 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:44:59.964557 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:59.964521 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:44:59.965036 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:44:59.964569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:44:59.965036 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:59.964657 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:44:59.965036 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:44:59.964795 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:00.965553 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:00.965520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:00.965990 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:00.965625 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:01.964753 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:01.964703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:01.964939 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:01.964708 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:01.964939 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:01.964845 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:01.965046 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:01.964941 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:02.965069 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:02.965034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:02.965479 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:02.965206 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:03.964704 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:03.964671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:03.964704 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:03.964707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:03.964956 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:03.964796 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:03.964956 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:03.964882 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:04.964650 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:04.964421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:04.965106 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:04.964807 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:05.046427 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.046218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"d2e03f8e3ca7cda3fb4cc759052f94a17d19640a31ed3ec5e513fbb3303285c3"} Jul 22 01:45:05.048790 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.048734 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9wf5" event={"ID":"e3a2f968-04fe-417e-a9bc-92ab4f939906","Type":"ContainerStarted","Data":"f3c8ff9c8b70be0a8f79c283b76aa82b74c34e5a54dcbfbeca4a09deaf3279f4"} Jul 22 01:45:05.053420 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.053000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" event={"ID":"8f8524ca7c47e8bba520d13ce2994f71","Type":"ContainerStarted","Data":"d0bd518eb95390db8837d1decb9c43bbee5c065bc8052643c543a361b2ae8492"} Jul 22 01:45:05.057527 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.057456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52w6n" event={"ID":"f919c0f1-1f3a-4be2-ab81-6daeb2435c0e","Type":"ContainerStarted","Data":"4302c9a250b5404f47233b7992c42f719c732eb0c3b28bb314588ba3bc338605"} Jul 22 01:45:05.059320 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.059288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hflfz" event={"ID":"1576cc62-f732-4d31-8e89-959676e51c35","Type":"ContainerStarted","Data":"7c86afdadc2f4e6c34ff47bd272627562c8a10e338e818b764fb6465da2ecff4"} Jul 22 01:45:05.063648 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.063625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wmhts" event={"ID":"6ae640e3-9062-4185-a55a-6048287c5ff3","Type":"ContainerStarted","Data":"226f7c8bc05adef597ba3ea6c4261a8f9780e8d1d1c83e716fd786c26886c1d0"} Jul 22 01:45:05.066780 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.066598 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t9wf5" podStartSLOduration=2.454857837 podStartE2EDuration="23.066587247s" totalImagesPullingTime="20.61172941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:05.066402456 +0000 UTC m=+24.617616169" watchObservedRunningTime="2026-07-22 01:45:05.066587247 +0000 UTC m=+24.617800960" Jul 22 01:45:05.083849 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.083796 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-12.ec2.internal" podStartSLOduration=23.083777158 podStartE2EDuration="23.083777158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:05.083608192 +0000 UTC m=+24.634821905" watchObservedRunningTime="2026-07-22 01:45:05.083777158 +0000 UTC m=+24.634990871" Jul 22 01:45:05.097107 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.097068 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-52w6n" podStartSLOduration=2.506618773 podStartE2EDuration="23.09705399s" totalImagesPullingTime="20.590435217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:05.096861135 +0000 UTC m=+24.648074848" watchObservedRunningTime="2026-07-22 01:45:05.09705399 +0000 UTC m=+24.648267702" Jul 22 01:45:05.110035 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.109999 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wmhts" podStartSLOduration=2.683271555 podStartE2EDuration="23.109980767s" totalImagesPullingTime="20.426709212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:05.10992797 +0000 UTC m=+24.661141684" watchObservedRunningTime="2026-07-22 01:45:05.109980767 +0000 UTC m=+24.661194480" Jul 22 01:45:05.124704 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.124668 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hflfz" podStartSLOduration=3.45746066 podStartE2EDuration="24.124651565s" totalImagesPullingTime="20.667190905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:05.124495647 +0000 UTC m=+24.675709361" watchObservedRunningTime="2026-07-22 01:45:05.124651565 +0000 UTC m=+24.675865281" Jul 22 01:45:05.212346 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.212316 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:45:05.213138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.213123 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:45:05.965091 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.964892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:05.965806 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:05.964892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:05.965806 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:05.965197 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:05.965806 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:05.965279 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:06.066821 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.066786 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9phhl" event={"ID":"832d1177-661d-466e-813c-1edcaff38e0b","Type":"ContainerStarted","Data":"d9cc188da48a732d2c32c3dc51befd612562ac085b1859e0397c066bba4cb7c6"} Jul 22 01:45:06.068253 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.068227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" event={"ID":"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d","Type":"ContainerStarted","Data":"a94690d01c64e2fb63775501f85b7d00c52f829b470dc27cc943731133db0b65"} Jul 22 01:45:06.069428 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.069404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7z4k" event={"ID":"17ffc3c7-6fca-4338-9743-09f062360a3b","Type":"ContainerStarted","Data":"fc9d80b2cb03de66e00679e9fbe73b74a34808824f78150afae0c9e5e1c8e961"} Jul 22 01:45:06.070677 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.070654 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dc02d073e845739ff107ec54f6a26bb" containerID="e89daebdf5ff5eef7a31182911ab24d75903bd39910e2458c89645fd062472d3" exitCode=0 Jul 22 01:45:06.070801 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.070737 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" event={"ID":"2dc02d073e845739ff107ec54f6a26bb","Type":"ContainerDied","Data":"e89daebdf5ff5eef7a31182911ab24d75903bd39910e2458c89645fd062472d3"} Jul 22 01:45:06.075599 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.075580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:45:06.075981 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.075954 2579 generic.go:356] "Generic (PLEG): container finished" podID="0cd82753-62c6-44a4-a650-55aaf0c4914f" containerID="73e1ed8eaed5b5a11c5972013881574e910bca0ef3f8a571ca9f865de827fdd2" exitCode=1 Jul 22 01:45:06.076086 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.076021 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerDied","Data":"73e1ed8eaed5b5a11c5972013881574e910bca0ef3f8a571ca9f865de827fdd2"} Jul 22 01:45:06.076131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.076088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"3a6ceb1315545f703bcb4efaae6b43ada36bddc8e2188057e65d901315faaa3c"} Jul 22 01:45:06.076131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.076126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"1f147c145c61849e9394242b9be646a040786b9767ba363d19387550e34a0192"} Jul 22 01:45:06.076233 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.076219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"5164678e0ab0b2eaa37d2fddac41ce5afe680acee6e5e43ebb4ad4920347759d"} Jul 22 01:45:06.076286 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.076270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"4642ae441500eb365c46e49af9433dcb255a67acdd027750a0327579420a2b81"} Jul 22 01:45:06.077363 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.077340 2579 generic.go:356] "Generic (PLEG): container finished" podID="d673ede1-f8bf-4f04-bd37-2bfb9cac29ec" containerID="fe548ca612c09034f01607d4bbd749065b6a3e7147a09050d6fc6fdb4f5ccadd" exitCode=0 Jul 22 01:45:06.077460 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.077414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerDied","Data":"fe548ca612c09034f01607d4bbd749065b6a3e7147a09050d6fc6fdb4f5ccadd"} Jul 22 01:45:06.079295 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.079260 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:45:06.079490 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.079472 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wmhts" Jul 22 01:45:06.082231 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.082190 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9phhl" podStartSLOduration=3.64526256 podStartE2EDuration="24.082176336s" totalImagesPullingTime="20.436913776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:06.080919402 +0000 UTC m=+25.632133118" watchObservedRunningTime="2026-07-22 01:45:06.082176336 +0000 UTC m=+25.633390048" Jul 22 01:45:06.110778 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.110715 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d7z4k" podStartSLOduration=4.486149979 podStartE2EDuration="25.110694944s" totalImagesPullingTime="20.624544965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:06.110117614 +0000 UTC m=+25.661331330" watchObservedRunningTime="2026-07-22 01:45:06.110694944 +0000 UTC m=+25.661908657" Jul 22 01:45:06.345625 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.345603 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 01:45:06.965352 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.965325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:06.965881 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:06.965424 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:06.975889 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.975780 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T01:45:06.345619274Z","UUID":"4f4790fb-db32-45b2-9267-fb57642e0e25","Handler":null,"Name":"","Endpoint":""} Jul 22 01:45:06.978207 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.978183 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 01:45:06.978327 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:06.978227 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 01:45:07.081949 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:07.081911 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" event={"ID":"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d","Type":"ContainerStarted","Data":"ca150540105e01d8ea0a66c52177f686cabce702de46484412c4af9d58b9d8f0"} Jul 22 01:45:07.083922 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:07.083890 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" event={"ID":"2dc02d073e845739ff107ec54f6a26bb","Type":"ContainerStarted","Data":"90fb96e4c481e5f1312c59043a8c27078feb31755a938566cefc19293b883d51"} Jul 22 01:45:07.099256 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:07.099211 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-12.ec2.internal" podStartSLOduration=25.09919204 podStartE2EDuration="25.09919204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:07.099022117 +0000 UTC m=+26.650235830" watchObservedRunningTime="2026-07-22 01:45:07.09919204 +0000 UTC m=+26.650405754" Jul 22 01:45:07.964795 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:07.964549 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:07.964960 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:07.964608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:07.964960 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:07.964866 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:07.965077 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:07.965004 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:08.088570 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:08.088533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" event={"ID":"efae65a2-ecec-4ff9-9e24-3c86c7d9a26d","Type":"ContainerStarted","Data":"ed5f807a0799d648a9ce034860e6acde9a43d1737e163ece4ea999b456141dee"} Jul 22 01:45:08.092212 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:08.092189 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:45:08.092571 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:08.092535 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"1327d74185da71a86f9816df3577b34e96400bb36adfe49bf3908ef8fab9ad76"} Jul 22 01:45:08.105608 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:08.105558 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xlwxm" podStartSLOduration=3.057486449 podStartE2EDuration="26.105544536s" totalImagesPullingTime="23.048058087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:08.10483109 +0000 UTC m=+27.656044803" watchObservedRunningTime="2026-07-22 01:45:08.105544536 +0000 UTC m=+27.656758253" Jul 22 01:45:08.965052 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:08.965024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:08.965228 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:08.965125 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:09.964780 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:09.964737 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:09.964780 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:09.964785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:09.965376 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:09.964894 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:09.965376 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:09.965042 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:10.965669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:10.965491 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:10.966224 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:10.965756 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:11.100928 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.100905 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:45:11.101298 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.101266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"33d41fd00db23332e816e57ab25d3e2869c17cc0dfe2979389977a162123ef4f"} Jul 22 01:45:11.101505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.101480 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:45:11.101665 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.101650 2579 scope.go:117] "RemoveContainer" containerID="73e1ed8eaed5b5a11c5972013881574e910bca0ef3f8a571ca9f865de827fdd2" Jul 22 01:45:11.103012 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.102984 2579 generic.go:356] "Generic (PLEG): container finished" podID="d673ede1-f8bf-4f04-bd37-2bfb9cac29ec" containerID="90539456cd51c9f1299b7ab618344ac64c219f0bf3b0f15e03dc64b831b411bc" exitCode=0 Jul 22 01:45:11.103094 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.103037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerDied","Data":"90539456cd51c9f1299b7ab618344ac64c219f0bf3b0f15e03dc64b831b411bc"} Jul 22 01:45:11.116643 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.116625 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:45:11.965248 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.965214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:11.965512 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:11.965345 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:11.965512 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:11.965409 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:11.965597 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:11.965533 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:12.108901 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.108877 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:45:12.109317 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.109188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" event={"ID":"0cd82753-62c6-44a4-a650-55aaf0c4914f","Type":"ContainerStarted","Data":"514ebcb9eceb3a9aa6c548da8fe1355ae667d2fcba95d97fb4e263d3ba761344"} Jul 22 01:45:12.109384 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.109367 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:45:12.109436 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.109420 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:45:12.124448 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.124416 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:45:12.136469 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.136422 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" podStartSLOduration=9.012583757 podStartE2EDuration="30.136407083s" totalImagesPullingTime="21.123823326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:12.135736316 +0000 UTC m=+31.686950029" watchObservedRunningTime="2026-07-22 01:45:12.136407083 +0000 UTC m=+31.687620795" Jul 22 01:45:12.590232 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.588667 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w6zb4"] Jul 22 01:45:12.590232 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.588871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:12.590232 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:12.589052 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:12.595172 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.595146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4mwsg"] Jul 22 01:45:12.595289 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.595254 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:12.595378 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:12.595359 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:12.597066 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.597045 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdw2x"] Jul 22 01:45:12.597147 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:12.597124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:12.597212 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:12.597195 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:13.113282 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:13.113238 2579 generic.go:356] "Generic (PLEG): container finished" podID="d673ede1-f8bf-4f04-bd37-2bfb9cac29ec" containerID="ac264805a04739e6241ee02aa513221f86d033d698e81f0bdec113f0c0b2d64d" exitCode=0 Jul 22 01:45:13.113694 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:13.113323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerDied","Data":"ac264805a04739e6241ee02aa513221f86d033d698e81f0bdec113f0c0b2d64d"} Jul 22 01:45:13.621496 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:13.621462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:13.621661 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.621607 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:45:13.621706 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.621684 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs podName:aa670b94-03c6-4342-95f9-f0d4e6737ebd nodeName:}" failed. No retries permitted until 2026-07-22 01:45:45.621665793 +0000 UTC m=+65.172879501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs") pod "network-metrics-daemon-4mwsg" (UID: "aa670b94-03c6-4342-95f9-f0d4e6737ebd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:45:13.722685 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:13.722657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:13.722840 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.722804 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:45:13.722881 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.722860 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret podName:2412d691-73e5-4f34-a229-5b037e35536c nodeName:}" failed. No retries permitted until 2026-07-22 01:45:45.722845433 +0000 UTC m=+65.274059124 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret") pod "global-pull-secret-syncer-w6zb4" (UID: "2412d691-73e5-4f34-a229-5b037e35536c") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:45:13.823341 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:13.823302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:13.823499 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.823421 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:45:13.823499 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.823435 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:45:13.823499 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.823443 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2j48q for pod openshift-network-diagnostics/network-check-target-vdw2x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:45:13.823499 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.823489 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q podName:027fc867-c3e5-4706-b75f-e4246eb1f148 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:45.823476986 +0000 UTC m=+65.374690677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2j48q" (UniqueName: "kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q") pod "network-check-target-vdw2x" (UID: "027fc867-c3e5-4706-b75f-e4246eb1f148") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:45:13.965239 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:13.965205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:13.965378 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:13.965343 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:14.965104 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:14.965031 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:14.965509 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:14.965133 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:14.965509 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:14.965231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:14.965509 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:14.965333 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:15.119787 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:15.119737 2579 generic.go:356] "Generic (PLEG): container finished" podID="d673ede1-f8bf-4f04-bd37-2bfb9cac29ec" containerID="0263deb53f22d0583ad02b85ebf53afbad07ebd0622100a691bfadde353b51bd" exitCode=0 Jul 22 01:45:15.119787 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:15.119774 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerDied","Data":"0263deb53f22d0583ad02b85ebf53afbad07ebd0622100a691bfadde353b51bd"} Jul 22 01:45:15.964716 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:15.964686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:15.964900 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:15.964809 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdw2x" podUID="027fc867-c3e5-4706-b75f-e4246eb1f148" Jul 22 01:45:16.964758 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:16.964724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:16.965307 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:16.964731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:16.965307 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:16.964857 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mwsg" podUID="aa670b94-03c6-4342-95f9-f0d4e6737ebd" Jul 22 01:45:16.965307 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:16.964961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6zb4" podUID="2412d691-73e5-4f34-a229-5b037e35536c" Jul 22 01:45:17.251098 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.251015 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-12.ec2.internal" event="NodeReady" Jul 22 01:45:17.251264 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.251154 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 01:45:17.289563 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.289395 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9"] Jul 22 01:45:17.293125 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.293096 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5"] Jul 22 01:45:17.293553 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.293371 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.297349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.297327 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 01:45:17.297349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.297338 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h877r\"" Jul 22 01:45:17.298222 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.298202 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 01:45:17.298334 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.298312 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.298490 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.298474 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.298872 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.298854 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz"] Jul 22 01:45:17.298974 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.298958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:17.301399 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.301379 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 01:45:17.301515 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.301496 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.301618 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.301604 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.302486 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.302467 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs"] Jul 22 01:45:17.302603 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.302541 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fkbgh\"" Jul 22 01:45:17.302603 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.302572 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" Jul 22 01:45:17.305807 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.305788 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv"] Jul 22 01:45:17.306326 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.306298 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.306707 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.306686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.307132 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.307114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v6flb\"" Jul 22 01:45:17.307226 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.307166 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.309554 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.309534 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6cff9f6f56-fsz4n"] Jul 22 01:45:17.309944 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.309918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.311995 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.311974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.312206 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.312189 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 01:45:17.313232 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.312840 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 01:45:17.313232 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.312891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bdp9b\"" Jul 22 01:45:17.313232 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.313090 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.314936 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.314920 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.315425 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.314934 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 01:45:17.315793 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.315775 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m9x4j\"" Jul 22 01:45:17.316173 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.316158 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 01:45:17.316293 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.316213 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.317476 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.317458 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-89759b74f-xhn7m"] Jul 22 01:45:17.318362 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.318343 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.321078 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.321057 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 01:45:17.321505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.321485 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4nrgv\"" Jul 22 01:45:17.321669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.321650 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 01:45:17.321824 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.321807 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-c8rqz"] Jul 22 01:45:17.321937 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.321641 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.322100 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.321963 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 01:45:17.322193 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.322042 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 01:45:17.322193 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.322132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.322837 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.322808 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.324138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.324121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 01:45:17.325079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.324350 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-86kzc\"" Jul 22 01:45:17.325326 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.324411 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 01:45:17.325706 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.324430 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 01:45:17.326075 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.326055 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-8t54x"] Jul 22 01:45:17.326236 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.326218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.333049 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.333031 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5"] Jul 22 01:45:17.333131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.333071 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz"] Jul 22 01:45:17.333131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.333091 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9"] Jul 22 01:45:17.333131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.333114 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr"] Jul 22 01:45:17.333289 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.333191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.334214 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.334197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 01:45:17.334351 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.334333 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.334464 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.334445 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.334464 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.334399 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 01:45:17.335063 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.335046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-grf89\"" Jul 22 01:45:17.336736 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.336495 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-c8rqz"] Jul 22 01:45:17.336736 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.336532 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv"] Jul 22 01:45:17.336736 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.336557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs"] Jul 22 01:45:17.336736 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.336581 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-89759b74f-xhn7m"] Jul 22 01:45:17.336736 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.336608 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5vthq"] Jul 22 01:45:17.337034 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.336858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" Jul 22 01:45:17.344807 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.342452 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 01:45:17.344807 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.343276 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-svlw6"] Jul 22 01:45:17.344807 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.343610 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.344807 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.344358 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.346081 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.345489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vqcj6\"" Jul 22 01:45:17.346163 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.346149 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.346969 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.346935 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 01:45:17.348322 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.348299 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.348780 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.348734 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.349583 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.349559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4fr9q\"" Jul 22 01:45:17.349762 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.349728 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 01:45:17.349890 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.349870 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xrls9\"" Jul 22 01:45:17.350133 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.350087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr"] Jul 22 01:45:17.350133 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.350112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-8t54x"] Jul 22 01:45:17.350278 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.350186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.350346 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.350308 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 01:45:17.350862 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.350846 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 01:45:17.351580 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.351559 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 01:45:17.352015 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.351948 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 01:45:17.352357 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.352341 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 01:45:17.352672 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.352653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 01:45:17.352795 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.352720 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 01:45:17.352795 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.352776 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nz6sc\"" Jul 22 01:45:17.352997 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.352980 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5vthq"] Jul 22 01:45:17.354153 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.354137 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svlw6"] Jul 22 01:45:17.354971 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.354950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cff9f6f56-fsz4n"] Jul 22 01:45:17.450679 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96tt9\" (UniqueName: \"kubernetes.io/projected/957a46c5-dbaa-4221-8fd4-2516761a1548-kube-api-access-96tt9\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.450867 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wnpz\" (UniqueName: \"kubernetes.io/projected/001e6900-63b4-4ea4-a1f6-18e6b0517ce9-kube-api-access-6wnpz\") pod \"ingress-canary-5vthq\" (UID: \"001e6900-63b4-4ea4-a1f6-18e6b0517ce9\") " pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.450867 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66rt9\" (UniqueName: \"kubernetes.io/projected/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-kube-api-access-66rt9\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:17.450867 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/593d01bf-b1ff-4bdd-af20-3f7281ae483c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.450867 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxvn5\" (UniqueName: \"kubernetes.io/projected/772900da-da16-4967-a7c6-d802a473d9b8-kube-api-access-nxvn5\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.450867 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1311591e-2c35-42cc-9911-9b536a652a9e-serving-cert\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.450867 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgnlk\" (UniqueName: \"kubernetes.io/projected/2191f662-d32f-4565-b920-a3495f5e529d-kube-api-access-sgnlk\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-ca-trust-extracted\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1311591e-2c35-42cc-9911-9b536a652a9e-tmp\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/593d01bf-b1ff-4bdd-af20-3f7281ae483c-config\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-certificates\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-image-registry-private-configuration\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.450981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-bound-sa-token\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-trusted-ca\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1311591e-2c35-42cc-9911-9b536a652a9e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772900da-da16-4967-a7c6-d802a473d9b8-trusted-ca\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/001e6900-63b4-4ea4-a1f6-18e6b0517ce9-cert\") pod \"ingress-canary-5vthq\" (UID: \"001e6900-63b4-4ea4-a1f6-18e6b0517ce9\") " pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.451177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1311591e-2c35-42cc-9911-9b536a652a9e-snapshots\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/209ee414-fb96-40ca-923b-4f5cd09cf320-config-volume\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48n7w\" (UniqueName: \"kubernetes.io/projected/1311591e-2c35-42cc-9911-9b536a652a9e-kube-api-access-48n7w\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/772900da-da16-4967-a7c6-d802a473d9b8-serving-cert\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz47m\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-kube-api-access-tz47m\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/209ee414-fb96-40ca-923b-4f5cd09cf320-tmp-dir\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/772900da-da16-4967-a7c6-d802a473d9b8-config\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27l9c\" (UniqueName: \"kubernetes.io/projected/016898b7-30e3-4bc7-966f-2dae000dbe52-kube-api-access-27l9c\") pod \"network-check-source-7bc5b6bf85-c8phr\" (UID: \"016898b7-30e3-4bc7-966f-2dae000dbe52\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsbmg\" (UniqueName: \"kubernetes.io/projected/52496b90-523c-4e08-8d41-ef086da087a5-kube-api-access-rsbmg\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.451695 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52496b90-523c-4e08-8d41-ef086da087a5-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451651 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtrds\" (UniqueName: \"kubernetes.io/projected/209ee414-fb96-40ca-923b-4f5cd09cf320-kube-api-access-jtrds\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-stats-auth\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkk6b\" (UniqueName: \"kubernetes.io/projected/a057728c-887f-47e5-8579-4f00f07a28d0-kube-api-access-zkk6b\") pod \"volume-data-source-validator-78cf4c6f6-bwhwz\" (UID: \"a057728c-887f-47e5-8579-4f00f07a28d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52496b90-523c-4e08-8d41-ef086da087a5-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-installation-pull-secrets\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffzv\" (UniqueName: \"kubernetes.io/projected/593d01bf-b1ff-4bdd-af20-3f7281ae483c-kube-api-access-cffzv\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/957a46c5-dbaa-4221-8fd4-2516761a1548-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-default-certificate\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1311591e-2c35-42cc-9911-9b536a652a9e-service-ca-bundle\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.452284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.451916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.552582 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1311591e-2c35-42cc-9911-9b536a652a9e-tmp\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.552582 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/593d01bf-b1ff-4bdd-af20-3f7281ae483c-config\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.552582 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-certificates\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.552842 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-image-registry-private-configuration\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.552842 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-bound-sa-token\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.552842 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-trusted-ca\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.552842 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1311591e-2c35-42cc-9911-9b536a652a9e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772900da-da16-4967-a7c6-d802a473d9b8-trusted-ca\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/001e6900-63b4-4ea4-a1f6-18e6b0517ce9-cert\") pod \"ingress-canary-5vthq\" (UID: \"001e6900-63b4-4ea4-a1f6-18e6b0517ce9\") " pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1311591e-2c35-42cc-9911-9b536a652a9e-tmp\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1311591e-2c35-42cc-9911-9b536a652a9e-snapshots\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/209ee414-fb96-40ca-923b-4f5cd09cf320-config-volume\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.552994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.553023 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48n7w\" (UniqueName: \"kubernetes.io/projected/1311591e-2c35-42cc-9911-9b536a652a9e-kube-api-access-48n7w\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553049 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/772900da-da16-4967-a7c6-d802a473d9b8-serving-cert\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz47m\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-kube-api-access-tz47m\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/209ee414-fb96-40ca-923b-4f5cd09cf320-tmp-dir\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/772900da-da16-4967-a7c6-d802a473d9b8-config\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27l9c\" (UniqueName: \"kubernetes.io/projected/016898b7-30e3-4bc7-966f-2dae000dbe52-kube-api-access-27l9c\") pod \"network-check-source-7bc5b6bf85-c8phr\" (UID: \"016898b7-30e3-4bc7-966f-2dae000dbe52\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbmg\" (UniqueName: \"kubernetes.io/projected/52496b90-523c-4e08-8d41-ef086da087a5-kube-api-access-rsbmg\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52496b90-523c-4e08-8d41-ef086da087a5-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553316 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-certificates\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtrds\" (UniqueName: \"kubernetes.io/projected/209ee414-fb96-40ca-923b-4f5cd09cf320-kube-api-access-jtrds\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.553421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-stats-auth\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkk6b\" (UniqueName: \"kubernetes.io/projected/a057728c-887f-47e5-8579-4f00f07a28d0-kube-api-access-zkk6b\") pod \"volume-data-source-validator-78cf4c6f6-bwhwz\" (UID: \"a057728c-887f-47e5-8579-4f00f07a28d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553490 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1311591e-2c35-42cc-9911-9b536a652a9e-snapshots\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52496b90-523c-4e08-8d41-ef086da087a5-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-installation-pull-secrets\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffzv\" (UniqueName: \"kubernetes.io/projected/593d01bf-b1ff-4bdd-af20-3f7281ae483c-kube-api-access-cffzv\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/957a46c5-dbaa-4221-8fd4-2516761a1548-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.553631 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.553649 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-89759b74f-xhn7m: secret "image-registry-tls" not found Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.553707 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls podName:a10f0d88-ea23-47cd-8606-d5d9d2e583b1 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:18.053687718 +0000 UTC m=+37.604901411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls") pod "image-registry-89759b74f-xhn7m" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1") : secret "image-registry-tls" not found Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553792 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772900da-da16-4967-a7c6-d802a473d9b8-trusted-ca\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.553818 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:45:17.554032 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.553878 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls podName:cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e nodeName:}" failed. No retries permitted until 2026-07-22 01:45:18.053861656 +0000 UTC m=+37.605075368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4n2g5" (UID: "cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e") : secret "samples-operator-tls" not found Jul 22 01:45:17.554594 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.554335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/593d01bf-b1ff-4bdd-af20-3f7281ae483c-config\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.554594 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.554364 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:17.554594 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.554453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls podName:957a46c5-dbaa-4221-8fd4-2516761a1548 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:18.054438658 +0000 UTC m=+37.605652372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w7kbs" (UID: "957a46c5-dbaa-4221-8fd4-2516761a1548") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.558214 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.558515 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:18.058498705 +0000 UTC m=+37.609712401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : secret "router-metrics-certs-default" not found Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.555625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/209ee414-fb96-40ca-923b-4f5cd09cf320-config-volume\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.556534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-trusted-ca\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.557344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/209ee414-fb96-40ca-923b-4f5cd09cf320-tmp-dir\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.556314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1311591e-2c35-42cc-9911-9b536a652a9e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.558436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/772900da-da16-4967-a7c6-d802a473d9b8-serving-cert\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.558686 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:18.058664356 +0000 UTC m=+37.609878066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : configmap references non-existent config key: service-ca.crt Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.553631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-default-certificate\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.558730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1311591e-2c35-42cc-9911-9b536a652a9e-service-ca-bundle\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.558791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/957a46c5-dbaa-4221-8fd4-2516761a1548-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.560131 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-image-registry-private-configuration\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96tt9\" (UniqueName: \"kubernetes.io/projected/957a46c5-dbaa-4221-8fd4-2516761a1548-kube-api-access-96tt9\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wnpz\" (UniqueName: \"kubernetes.io/projected/001e6900-63b4-4ea4-a1f6-18e6b0517ce9-kube-api-access-6wnpz\") pod \"ingress-canary-5vthq\" (UID: \"001e6900-63b4-4ea4-a1f6-18e6b0517ce9\") " pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66rt9\" (UniqueName: \"kubernetes.io/projected/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-kube-api-access-66rt9\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/593d01bf-b1ff-4bdd-af20-3f7281ae483c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxvn5\" (UniqueName: \"kubernetes.io/projected/772900da-da16-4967-a7c6-d802a473d9b8-kube-api-access-nxvn5\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1311591e-2c35-42cc-9911-9b536a652a9e-serving-cert\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgnlk\" (UniqueName: \"kubernetes.io/projected/2191f662-d32f-4565-b920-a3495f5e529d-kube-api-access-sgnlk\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.559970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-ca-trust-extracted\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.560326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-ca-trust-extracted\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.560866 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.560782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1311591e-2c35-42cc-9911-9b536a652a9e-service-ca-bundle\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.561366 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.560977 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:45:17.561366 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:17.561044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls podName:209ee414-fb96-40ca-923b-4f5cd09cf320 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:18.061021958 +0000 UTC m=+37.612235656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls") pod "dns-default-svlw6" (UID: "209ee414-fb96-40ca-923b-4f5cd09cf320") : secret "dns-default-metrics-tls" not found Jul 22 01:45:17.561366 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.561257 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52496b90-523c-4e08-8d41-ef086da087a5-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.564264 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.564237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/001e6900-63b4-4ea4-a1f6-18e6b0517ce9-cert\") pod \"ingress-canary-5vthq\" (UID: \"001e6900-63b4-4ea4-a1f6-18e6b0517ce9\") " pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.565930 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.564555 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1311591e-2c35-42cc-9911-9b536a652a9e-serving-cert\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.565930 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.564975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-default-certificate\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.565930 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.565094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/772900da-da16-4967-a7c6-d802a473d9b8-config\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.565930 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.565165 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-installation-pull-secrets\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.565930 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.565206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-stats-auth\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.565930 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.565543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsbmg\" (UniqueName: \"kubernetes.io/projected/52496b90-523c-4e08-8d41-ef086da087a5-kube-api-access-rsbmg\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.565930 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.565606 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-bound-sa-token\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.566612 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.566553 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52496b90-523c-4e08-8d41-ef086da087a5-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-8cckv\" (UID: \"52496b90-523c-4e08-8d41-ef086da087a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.567405 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.567381 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27l9c\" (UniqueName: \"kubernetes.io/projected/016898b7-30e3-4bc7-966f-2dae000dbe52-kube-api-access-27l9c\") pod \"network-check-source-7bc5b6bf85-c8phr\" (UID: \"016898b7-30e3-4bc7-966f-2dae000dbe52\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" Jul 22 01:45:17.568890 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.568866 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/593d01bf-b1ff-4bdd-af20-3f7281ae483c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.570408 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.570387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48n7w\" (UniqueName: \"kubernetes.io/projected/1311591e-2c35-42cc-9911-9b536a652a9e-kube-api-access-48n7w\") pod \"insights-operator-555d9d7885-c8rqz\" (UID: \"1311591e-2c35-42cc-9911-9b536a652a9e\") " pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.570545 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.570468 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wnpz\" (UniqueName: \"kubernetes.io/projected/001e6900-63b4-4ea4-a1f6-18e6b0517ce9-kube-api-access-6wnpz\") pod \"ingress-canary-5vthq\" (UID: \"001e6900-63b4-4ea4-a1f6-18e6b0517ce9\") " pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.571400 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.571362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtrds\" (UniqueName: \"kubernetes.io/projected/209ee414-fb96-40ca-923b-4f5cd09cf320-kube-api-access-jtrds\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:17.572632 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.572589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgnlk\" (UniqueName: \"kubernetes.io/projected/2191f662-d32f-4565-b920-a3495f5e529d-kube-api-access-sgnlk\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:17.573899 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.573846 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxvn5\" (UniqueName: \"kubernetes.io/projected/772900da-da16-4967-a7c6-d802a473d9b8-kube-api-access-nxvn5\") pod \"console-operator-565b7b569d-8t54x\" (UID: \"772900da-da16-4967-a7c6-d802a473d9b8\") " pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.574086 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.574063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffzv\" (UniqueName: \"kubernetes.io/projected/593d01bf-b1ff-4bdd-af20-3f7281ae483c-kube-api-access-cffzv\") pod \"service-ca-operator-5bcbc94c78-rzwq9\" (UID: \"593d01bf-b1ff-4bdd-af20-3f7281ae483c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.574218 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.574193 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkk6b\" (UniqueName: \"kubernetes.io/projected/a057728c-887f-47e5-8579-4f00f07a28d0-kube-api-access-zkk6b\") pod \"volume-data-source-validator-78cf4c6f6-bwhwz\" (UID: \"a057728c-887f-47e5-8579-4f00f07a28d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" Jul 22 01:45:17.574306 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.574285 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz47m\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-kube-api-access-tz47m\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:17.574732 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.574696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96tt9\" (UniqueName: \"kubernetes.io/projected/957a46c5-dbaa-4221-8fd4-2516761a1548-kube-api-access-96tt9\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:17.575341 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.575320 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66rt9\" (UniqueName: \"kubernetes.io/projected/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-kube-api-access-66rt9\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:17.607379 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.607348 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" Jul 22 01:45:17.629365 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.629329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" Jul 22 01:45:17.645915 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.645885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" Jul 22 01:45:17.674434 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.674405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-c8rqz" Jul 22 01:45:17.680610 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.680587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:17.688312 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.688293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" Jul 22 01:45:17.694831 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.694807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5vthq" Jul 22 01:45:17.964538 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.964501 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:17.966669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:17.966646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wgwz\"" Jul 22 01:45:18.064712 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.064672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:18.064906 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.064756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:18.064906 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.064805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:18.064906 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.064834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:18.064906 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.064867 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:45:18.064906 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.064901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.064912 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.064926 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.064936 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:19.064915995 +0000 UTC m=+38.616129687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : secret "router-metrics-certs-default" not found Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.064973 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls podName:cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e nodeName:}" failed. No retries permitted until 2026-07-22 01:45:19.064954412 +0000 UTC m=+38.616168108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4n2g5" (UID: "cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e") : secret "samples-operator-tls" not found Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.064984 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.064997 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls podName:957a46c5-dbaa-4221-8fd4-2516761a1548 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:19.064986416 +0000 UTC m=+38.616200108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w7kbs" (UID: "957a46c5-dbaa-4221-8fd4-2516761a1548") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.065019 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:19.065009766 +0000 UTC m=+38.616223463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : configmap references non-existent config key: service-ca.crt Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.065044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls podName:209ee414-fb96-40ca-923b-4f5cd09cf320 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:19.065028461 +0000 UTC m=+38.616242156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls") pod "dns-default-svlw6" (UID: "209ee414-fb96-40ca-923b-4f5cd09cf320") : secret "dns-default-metrics-tls" not found Jul 22 01:45:18.065164 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.065133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:18.065600 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.065237 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:45:18.065600 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.065249 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-89759b74f-xhn7m: secret "image-registry-tls" not found Jul 22 01:45:18.065600 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:18.065295 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls podName:a10f0d88-ea23-47cd-8606-d5d9d2e583b1 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:19.065282996 +0000 UTC m=+38.616496688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls") pod "image-registry-89759b74f-xhn7m" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1") : secret "image-registry-tls" not found Jul 22 01:45:18.965299 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.965074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:18.965478 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.965151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:18.967715 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.967693 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:45:18.968097 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.967720 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cgfms\"" Jul 22 01:45:18.968156 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:18.968108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:45:19.075103 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.074646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:19.075103 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.074718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:19.075103 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.074949 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:45:19.075103 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.074967 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-89759b74f-xhn7m: secret "image-registry-tls" not found Jul 22 01:45:19.075103 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.075019 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:45:19.075103 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.075045 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls podName:a10f0d88-ea23-47cd-8606-d5d9d2e583b1 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:21.075020863 +0000 UTC m=+40.626234570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls") pod "image-registry-89759b74f-xhn7m" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1") : secret "image-registry-tls" not found Jul 22 01:45:19.075103 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.075088 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:21.07506809 +0000 UTC m=+40.626281800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : secret "router-metrics-certs-default" not found Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.076026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.076091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.076125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.076217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.076376 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.076417 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls podName:209ee414-fb96-40ca-923b-4f5cd09cf320 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:21.076403779 +0000 UTC m=+40.627617473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls") pod "dns-default-svlw6" (UID: "209ee414-fb96-40ca-923b-4f5cd09cf320") : secret "dns-default-metrics-tls" not found Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.076481 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.076516 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls podName:cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e nodeName:}" failed. No retries permitted until 2026-07-22 01:45:21.076505104 +0000 UTC m=+40.627718809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4n2g5" (UID: "cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e") : secret "samples-operator-tls" not found Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.076568 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.076601 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls podName:957a46c5-dbaa-4221-8fd4-2516761a1548 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:21.076588251 +0000 UTC m=+40.627801943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w7kbs" (UID: "957a46c5-dbaa-4221-8fd4-2516761a1548") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:19.077073 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:19.076676 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:21.07666493 +0000 UTC m=+40.627878623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : configmap references non-existent config key: service-ca.crt Jul 22 01:45:19.313859 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.313792 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv"] Jul 22 01:45:19.318418 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.318016 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9"] Jul 22 01:45:19.321470 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:19.321392 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52496b90_523c_4e08_8d41_ef086da087a5.slice/crio-0ce95b686857fa0393ef5d4a85cba8616cf2822199a8882a0fc5fa1143fbce47 WatchSource:0}: Error finding container 0ce95b686857fa0393ef5d4a85cba8616cf2822199a8882a0fc5fa1143fbce47: Status 404 returned error can't find the container with id 0ce95b686857fa0393ef5d4a85cba8616cf2822199a8882a0fc5fa1143fbce47 Jul 22 01:45:19.322758 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:19.322583 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593d01bf_b1ff_4bdd_af20_3f7281ae483c.slice/crio-107d54eb69f933663175b7643980f2790184c1eb38a1b7b5530616e07500d6e7 WatchSource:0}: Error finding container 107d54eb69f933663175b7643980f2790184c1eb38a1b7b5530616e07500d6e7: Status 404 returned error can't find the container with id 107d54eb69f933663175b7643980f2790184c1eb38a1b7b5530616e07500d6e7 Jul 22 01:45:19.332967 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.329356 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-8t54x"] Jul 22 01:45:19.332967 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.332086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr"] Jul 22 01:45:19.332967 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.332135 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-c8rqz"] Jul 22 01:45:19.341839 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:19.341816 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1311591e_2c35_42cc_9911_9b536a652a9e.slice/crio-7ef726e85ed17e463ab547d4bd65b130b6dc8c03db548fa72aae8f50e8c2dd2c WatchSource:0}: Error finding container 7ef726e85ed17e463ab547d4bd65b130b6dc8c03db548fa72aae8f50e8c2dd2c: Status 404 returned error can't find the container with id 7ef726e85ed17e463ab547d4bd65b130b6dc8c03db548fa72aae8f50e8c2dd2c Jul 22 01:45:19.346729 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.346708 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz"] Jul 22 01:45:19.349806 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:19.349785 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5vthq"] Jul 22 01:45:19.352581 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:19.352554 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001e6900_63b4_4ea4_a1f6_18e6b0517ce9.slice/crio-2acae112a52f2359fd05aa5484da408f90428294512ba5765b35e2564230f781 WatchSource:0}: Error finding container 2acae112a52f2359fd05aa5484da408f90428294512ba5765b35e2564230f781: Status 404 returned error can't find the container with id 2acae112a52f2359fd05aa5484da408f90428294512ba5765b35e2564230f781 Jul 22 01:45:19.353260 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:19.353240 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda057728c_887f_47e5_8579_4f00f07a28d0.slice/crio-bb75675675cc0088f189144cd261a7656a9b5a00b59c77ebaa3918eacafe8211 WatchSource:0}: Error finding container bb75675675cc0088f189144cd261a7656a9b5a00b59c77ebaa3918eacafe8211: Status 404 returned error can't find the container with id bb75675675cc0088f189144cd261a7656a9b5a00b59c77ebaa3918eacafe8211 Jul 22 01:45:20.141325 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.141289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c8rqz" event={"ID":"1311591e-2c35-42cc-9911-9b536a652a9e","Type":"ContainerStarted","Data":"7ef726e85ed17e463ab547d4bd65b130b6dc8c03db548fa72aae8f50e8c2dd2c"} Jul 22 01:45:20.146253 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.146182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5vthq" event={"ID":"001e6900-63b4-4ea4-a1f6-18e6b0517ce9","Type":"ContainerStarted","Data":"2acae112a52f2359fd05aa5484da408f90428294512ba5765b35e2564230f781"} Jul 22 01:45:20.149076 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.148986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" event={"ID":"016898b7-30e3-4bc7-966f-2dae000dbe52","Type":"ContainerStarted","Data":"39a3ee74ebf6a39d68c90c73671b87a4262eda43a9bd94b77ef048717c65332e"} Jul 22 01:45:20.151179 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.151074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" event={"ID":"52496b90-523c-4e08-8d41-ef086da087a5","Type":"ContainerStarted","Data":"0ce95b686857fa0393ef5d4a85cba8616cf2822199a8882a0fc5fa1143fbce47"} Jul 22 01:45:20.157035 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.156930 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" event={"ID":"772900da-da16-4967-a7c6-d802a473d9b8","Type":"ContainerStarted","Data":"2767a11c46995db75dcab0c251a656b331188c657eaae76d0b3c96e20a73d508"} Jul 22 01:45:20.160994 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.160886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" event={"ID":"a057728c-887f-47e5-8579-4f00f07a28d0","Type":"ContainerStarted","Data":"bb75675675cc0088f189144cd261a7656a9b5a00b59c77ebaa3918eacafe8211"} Jul 22 01:45:20.170008 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.168920 2579 generic.go:356] "Generic (PLEG): container finished" podID="d673ede1-f8bf-4f04-bd37-2bfb9cac29ec" containerID="864c625b030f1a6f51312faf68050d5775ef0bfb7c94598a74c594db5a418be9" exitCode=0 Jul 22 01:45:20.170008 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.168984 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerDied","Data":"864c625b030f1a6f51312faf68050d5775ef0bfb7c94598a74c594db5a418be9"} Jul 22 01:45:20.185673 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:20.185599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" event={"ID":"593d01bf-b1ff-4bdd-af20-3f7281ae483c","Type":"ContainerStarted","Data":"107d54eb69f933663175b7643980f2790184c1eb38a1b7b5530616e07500d6e7"} Jul 22 01:45:21.097677 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.097432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:21.097880 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.097765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:21.097880 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.097817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:21.097880 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.097858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:21.098041 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.097900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:21.098041 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.097928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:21.098159 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098077 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:25.098050166 +0000 UTC m=+44.649263860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : configmap references non-existent config key: service-ca.crt Jul 22 01:45:21.098589 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098569 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:45:21.098792 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098628 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls podName:cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e nodeName:}" failed. No retries permitted until 2026-07-22 01:45:25.098611163 +0000 UTC m=+44.649824857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4n2g5" (UID: "cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e") : secret "samples-operator-tls" not found Jul 22 01:45:21.098792 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098692 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:45:21.098792 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098704 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-89759b74f-xhn7m: secret "image-registry-tls" not found Jul 22 01:45:21.098792 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098736 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls podName:a10f0d88-ea23-47cd-8606-d5d9d2e583b1 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:25.098725707 +0000 UTC m=+44.649939399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls") pod "image-registry-89759b74f-xhn7m" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1") : secret "image-registry-tls" not found Jul 22 01:45:21.099027 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098805 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:45:21.099027 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098845 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:25.098835065 +0000 UTC m=+44.650048756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : secret "router-metrics-certs-default" not found Jul 22 01:45:21.099027 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098894 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:21.099027 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.098927 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls podName:957a46c5-dbaa-4221-8fd4-2516761a1548 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:25.098915133 +0000 UTC m=+44.650128830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w7kbs" (UID: "957a46c5-dbaa-4221-8fd4-2516761a1548") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:21.099285 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.099037 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:45:21.099285 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:21.099103 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls podName:209ee414-fb96-40ca-923b-4f5cd09cf320 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:25.099091199 +0000 UTC m=+44.650304892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls") pod "dns-default-svlw6" (UID: "209ee414-fb96-40ca-923b-4f5cd09cf320") : secret "dns-default-metrics-tls" not found Jul 22 01:45:21.208088 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.207147 2579 generic.go:356] "Generic (PLEG): container finished" podID="d673ede1-f8bf-4f04-bd37-2bfb9cac29ec" containerID="5e1525b915653ecd25bf3efe6fe50fa73ad69837f09e5fdb1a8abb0a6eb636cb" exitCode=0 Jul 22 01:45:21.208088 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:21.207195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerDied","Data":"5e1525b915653ecd25bf3efe6fe50fa73ad69837f09e5fdb1a8abb0a6eb636cb"} Jul 22 01:45:22.215566 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:22.215525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58n2m" event={"ID":"d673ede1-f8bf-4f04-bd37-2bfb9cac29ec","Type":"ContainerStarted","Data":"299f17b60991382ab30a512d14eedbe825f21eacbd42d15cf338f782235915b9"} Jul 22 01:45:22.245368 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:22.245300 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-58n2m" podStartSLOduration=9.769454061 podStartE2EDuration="41.245279202s" totalImagesPullingTime="31.475825141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:22.244156793 +0000 UTC m=+41.795370531" watchObservedRunningTime="2026-07-22 01:45:22.245279202 +0000 UTC m=+41.796492934" Jul 22 01:45:25.138673 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:25.138638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:25.138690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:25.138723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.138805 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.138828 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-89759b74f-xhn7m: secret "image-registry-tls" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.138859 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.138878 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls podName:a10f0d88-ea23-47cd-8606-d5d9d2e583b1 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:33.138861925 +0000 UTC m=+52.690075615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls") pod "image-registry-89759b74f-xhn7m" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1") : secret "image-registry-tls" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.138915 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.138919 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:33.138901773 +0000 UTC m=+52.690115469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : secret "router-metrics-certs-default" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:25.138977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:25.139010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.139028 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls podName:cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e nodeName:}" failed. No retries permitted until 2026-07-22 01:45:33.139010933 +0000 UTC m=+52.690224632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4n2g5" (UID: "cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e") : secret "samples-operator-tls" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.139079 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:25.139236 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.139081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:33.139070972 +0000 UTC m=+52.690284681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : configmap references non-existent config key: service-ca.crt Jul 22 01:45:25.139692 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.139157 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls podName:957a46c5-dbaa-4221-8fd4-2516761a1548 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:33.139140771 +0000 UTC m=+52.690354462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w7kbs" (UID: "957a46c5-dbaa-4221-8fd4-2516761a1548") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:25.139692 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:25.139212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:25.139692 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.139344 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:45:25.139692 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:25.139386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls podName:209ee414-fb96-40ca-923b-4f5cd09cf320 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:33.139375326 +0000 UTC m=+52.690589016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls") pod "dns-default-svlw6" (UID: "209ee414-fb96-40ca-923b-4f5cd09cf320") : secret "dns-default-metrics-tls" not found Jul 22 01:45:28.233900 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.233406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" event={"ID":"016898b7-30e3-4bc7-966f-2dae000dbe52","Type":"ContainerStarted","Data":"670baa39e5f11a3a2764c389e2ec30084902540b2f92bdc92e9b964f9c690707"} Jul 22 01:45:28.235097 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.235066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" event={"ID":"52496b90-523c-4e08-8d41-ef086da087a5","Type":"ContainerStarted","Data":"b9194b0e0b12c3c4f2091bb37e12ff8dec49122582127217ec906da145acab63"} Jul 22 01:45:28.237376 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.236991 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/0.log" Jul 22 01:45:28.237376 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.237036 2579 generic.go:356] "Generic (PLEG): container finished" podID="772900da-da16-4967-a7c6-d802a473d9b8" containerID="2abaf2afb58160bda6e532e403e563ab4bb68bd36d52d5032e6de339c7f66658" exitCode=255 Jul 22 01:45:28.237376 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.237109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" event={"ID":"772900da-da16-4967-a7c6-d802a473d9b8","Type":"ContainerDied","Data":"2abaf2afb58160bda6e532e403e563ab4bb68bd36d52d5032e6de339c7f66658"} Jul 22 01:45:28.237376 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.237313 2579 scope.go:117] "RemoveContainer" containerID="2abaf2afb58160bda6e532e403e563ab4bb68bd36d52d5032e6de339c7f66658" Jul 22 01:45:28.238928 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.238903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" event={"ID":"a057728c-887f-47e5-8579-4f00f07a28d0","Type":"ContainerStarted","Data":"f4928e3a4bc5609be4c7eb712de29c1909c6b76b8c1718eaf1ef86d03ad0beca"} Jul 22 01:45:28.240396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.240352 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" event={"ID":"593d01bf-b1ff-4bdd-af20-3f7281ae483c","Type":"ContainerStarted","Data":"8d835f354bf48a480e5b49d91cdc1568f76cd36707dd5704c51785b4226dd187"} Jul 22 01:45:28.242765 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.242420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c8rqz" event={"ID":"1311591e-2c35-42cc-9911-9b536a652a9e","Type":"ContainerStarted","Data":"ab8483de31bd1cfcf49e7bed184b5384247992d355d32f4c5111762ac398675a"} Jul 22 01:45:28.244090 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.244018 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5vthq" event={"ID":"001e6900-63b4-4ea4-a1f6-18e6b0517ce9","Type":"ContainerStarted","Data":"86058dcbf5e82fde55554f16fae90fd1a8a5f721f42be646e6e6d6d6e7638cfb"} Jul 22 01:45:28.251507 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.251463 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-c8phr" podStartSLOduration=12.271432332 podStartE2EDuration="20.251447118s" totalImagesPullingTime="7.980014786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:28.250514458 +0000 UTC m=+47.801728171" watchObservedRunningTime="2026-07-22 01:45:28.251447118 +0000 UTC m=+47.802660831" Jul 22 01:45:28.266169 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.266130 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5vthq" podStartSLOduration=3.500719179 podStartE2EDuration="11.266117656s" totalImagesPullingTime="7.765398477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:28.265728062 +0000 UTC m=+47.816941779" watchObservedRunningTime="2026-07-22 01:45:28.266117656 +0000 UTC m=+47.817331346" Jul 22 01:45:28.281539 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.281481 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bwhwz" podStartSLOduration=19.580080267 podStartE2EDuration="27.281464406s" totalImagesPullingTime="7.701384139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:28.279988534 +0000 UTC m=+47.831202248" watchObservedRunningTime="2026-07-22 01:45:28.281464406 +0000 UTC m=+47.832678123" Jul 22 01:45:28.303882 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.301999 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-c8rqz" podStartSLOduration=22.532785223 podStartE2EDuration="30.301981676s" totalImagesPullingTime="7.769196453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:28.298363458 +0000 UTC m=+47.849577173" watchObservedRunningTime="2026-07-22 01:45:28.301981676 +0000 UTC m=+47.853195392" Jul 22 01:45:28.324019 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.323969 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" podStartSLOduration=12.536160128 podStartE2EDuration="20.32395439s" totalImagesPullingTime="7.787794262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:28.322753845 +0000 UTC m=+47.873967558" watchObservedRunningTime="2026-07-22 01:45:28.32395439 +0000 UTC m=+47.875168103" Jul 22 01:45:28.347462 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:28.347405 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" podStartSLOduration=14.557627945 podStartE2EDuration="22.34738313s" totalImagesPullingTime="7.789755185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:28.346019179 +0000 UTC m=+47.897232895" watchObservedRunningTime="2026-07-22 01:45:28.34738313 +0000 UTC m=+47.898596823" Jul 22 01:45:29.028274 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.028220 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q9hgn"] Jul 22 01:45:29.048366 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.048339 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q9hgn"] Jul 22 01:45:29.048494 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.048474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.050511 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.050483 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 01:45:29.050662 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.050590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ldh2d\"" Jul 22 01:45:29.050815 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.050800 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 01:45:29.076559 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.076527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e5c8b14-7e4b-413a-be39-d59acef15c4b-crio-socket\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.076680 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.076590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.076725 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.076687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5c8b14-7e4b-413a-be39-d59acef15c4b-data-volume\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.076796 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.076767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.076831 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.076796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxpvz\" (UniqueName: \"kubernetes.io/projected/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-api-access-rxpvz\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178090 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.178043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5c8b14-7e4b-413a-be39-d59acef15c4b-data-volume\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178280 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.178161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178280 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.178217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxpvz\" (UniqueName: \"kubernetes.io/projected/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-api-access-rxpvz\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178280 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.178255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e5c8b14-7e4b-413a-be39-d59acef15c4b-crio-socket\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178438 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.178281 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 01:45:29.178438 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.178305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178438 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.178358 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:29.678334268 +0000 UTC m=+49.229547974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : configmap "kube-rbac-proxy" not found Jul 22 01:45:29.178438 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.178402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e5c8b14-7e4b-413a-be39-d59acef15c4b-crio-socket\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178624 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.178441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5c8b14-7e4b-413a-be39-d59acef15c4b-data-volume\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.178624 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.178485 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:45:29.178624 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.178543 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:29.678511816 +0000 UTC m=+49.229725507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : secret "insights-runtime-extractor-tls" not found Jul 22 01:45:29.189915 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.189889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxpvz\" (UniqueName: \"kubernetes.io/projected/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-api-access-rxpvz\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.248869 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.248831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:45:29.249273 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.249264 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/0.log" Jul 22 01:45:29.249324 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.249297 2579 generic.go:356] "Generic (PLEG): container finished" podID="772900da-da16-4967-a7c6-d802a473d9b8" containerID="7cef95ed0a53f2b4de59605a21fd49b34813c74bb2e3cc43300f3e6eddb3b798" exitCode=255 Jul 22 01:45:29.249434 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.249410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" event={"ID":"772900da-da16-4967-a7c6-d802a473d9b8","Type":"ContainerDied","Data":"7cef95ed0a53f2b4de59605a21fd49b34813c74bb2e3cc43300f3e6eddb3b798"} Jul 22 01:45:29.249493 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.249466 2579 scope.go:117] "RemoveContainer" containerID="2abaf2afb58160bda6e532e403e563ab4bb68bd36d52d5032e6de339c7f66658" Jul 22 01:45:29.250294 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.250273 2579 scope.go:117] "RemoveContainer" containerID="7cef95ed0a53f2b4de59605a21fd49b34813c74bb2e3cc43300f3e6eddb3b798" Jul 22 01:45:29.250474 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.250449 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-8t54x_openshift-console-operator(772900da-da16-4967-a7c6-d802a473d9b8)\"" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" podUID="772900da-da16-4967-a7c6-d802a473d9b8" Jul 22 01:45:29.649459 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.649430 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47"] Jul 22 01:45:29.676024 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.675999 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" Jul 22 01:45:29.678567 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.678538 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vp8wr\"" Jul 22 01:45:29.678864 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.678847 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 22 01:45:29.678972 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.678880 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 22 01:45:29.683336 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.683312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.683449 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.683403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:29.683449 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.683409 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 01:45:29.683573 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.683461 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:30.683446527 +0000 UTC m=+50.234660218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : configmap "kube-rbac-proxy" not found Jul 22 01:45:29.683573 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.683528 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:45:29.683686 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:29.683614 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:30.683599966 +0000 UTC m=+50.234813659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : secret "insights-runtime-extractor-tls" not found Jul 22 01:45:29.690196 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.690170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47"] Jul 22 01:45:29.784601 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.784571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9x8\" (UniqueName: \"kubernetes.io/projected/32d30519-6ff4-425b-a7a7-3022f5f5ad5d-kube-api-access-jb9x8\") pod \"migrator-7cc9c7ffd7-9lm47\" (UID: \"32d30519-6ff4-425b-a7a7-3022f5f5ad5d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" Jul 22 01:45:29.885080 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.885052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9x8\" (UniqueName: \"kubernetes.io/projected/32d30519-6ff4-425b-a7a7-3022f5f5ad5d-kube-api-access-jb9x8\") pod \"migrator-7cc9c7ffd7-9lm47\" (UID: \"32d30519-6ff4-425b-a7a7-3022f5f5ad5d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" Jul 22 01:45:29.893959 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.893937 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9x8\" (UniqueName: \"kubernetes.io/projected/32d30519-6ff4-425b-a7a7-3022f5f5ad5d-kube-api-access-jb9x8\") pod \"migrator-7cc9c7ffd7-9lm47\" (UID: \"32d30519-6ff4-425b-a7a7-3022f5f5ad5d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" Jul 22 01:45:29.985961 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:29.985888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" Jul 22 01:45:30.128595 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:30.128568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47"] Jul 22 01:45:30.131836 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:30.131806 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d30519_6ff4_425b_a7a7_3022f5f5ad5d.slice/crio-2576499455e4a5b9efb222e3bd7a28a6d3f61277f6ea7798224ab1fcf9067b3f WatchSource:0}: Error finding container 2576499455e4a5b9efb222e3bd7a28a6d3f61277f6ea7798224ab1fcf9067b3f: Status 404 returned error can't find the container with id 2576499455e4a5b9efb222e3bd7a28a6d3f61277f6ea7798224ab1fcf9067b3f Jul 22 01:45:30.255021 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:30.254939 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:45:30.255462 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:30.255302 2579 scope.go:117] "RemoveContainer" containerID="7cef95ed0a53f2b4de59605a21fd49b34813c74bb2e3cc43300f3e6eddb3b798" Jul 22 01:45:30.255520 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:30.255483 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-8t54x_openshift-console-operator(772900da-da16-4967-a7c6-d802a473d9b8)\"" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" podUID="772900da-da16-4967-a7c6-d802a473d9b8" Jul 22 01:45:30.256225 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:30.256207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" event={"ID":"32d30519-6ff4-425b-a7a7-3022f5f5ad5d","Type":"ContainerStarted","Data":"2576499455e4a5b9efb222e3bd7a28a6d3f61277f6ea7798224ab1fcf9067b3f"} Jul 22 01:45:30.417384 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:30.417355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52w6n_f919c0f1-1f3a-4be2-ab81-6daeb2435c0e/dns-node-resolver/0.log" Jul 22 01:45:30.692560 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:30.692524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:30.692776 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:30.692597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:30.692776 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:30.692640 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 01:45:30.692776 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:30.692735 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:32.692714229 +0000 UTC m=+52.243927924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : configmap "kube-rbac-proxy" not found Jul 22 01:45:30.692907 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:30.692794 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:45:30.692907 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:30.692886 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:32.692870136 +0000 UTC m=+52.244083827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : secret "insights-runtime-extractor-tls" not found Jul 22 01:45:31.250899 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.250863 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bwpx9"] Jul 22 01:45:31.281485 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.281436 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bwpx9"] Jul 22 01:45:31.281950 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.281532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.284085 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.284057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 22 01:45:31.284215 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.284059 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 22 01:45:31.284505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.284446 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 22 01:45:31.284505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.284496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nbw67\"" Jul 22 01:45:31.284703 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.284515 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 22 01:45:31.400175 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.400134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5861427e-d30b-494e-9862-b4cb7c5a7cda-signing-cabundle\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.400339 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.400272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5861427e-d30b-494e-9862-b4cb7c5a7cda-signing-key\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.400339 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.400307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjzr\" (UniqueName: \"kubernetes.io/projected/5861427e-d30b-494e-9862-b4cb7c5a7cda-kube-api-access-xmjzr\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.417313 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.417286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9phhl_832d1177-661d-466e-813c-1edcaff38e0b/node-ca/0.log" Jul 22 01:45:31.500870 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.500844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjzr\" (UniqueName: \"kubernetes.io/projected/5861427e-d30b-494e-9862-b4cb7c5a7cda-kube-api-access-xmjzr\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.501083 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.501041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5861427e-d30b-494e-9862-b4cb7c5a7cda-signing-cabundle\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.501163 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.501146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5861427e-d30b-494e-9862-b4cb7c5a7cda-signing-key\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.501626 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.501606 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5861427e-d30b-494e-9862-b4cb7c5a7cda-signing-cabundle\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.503383 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.503365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5861427e-d30b-494e-9862-b4cb7c5a7cda-signing-key\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.508642 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.508620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjzr\" (UniqueName: \"kubernetes.io/projected/5861427e-d30b-494e-9862-b4cb7c5a7cda-kube-api-access-xmjzr\") pod \"service-ca-58598695f7-bwpx9\" (UID: \"5861427e-d30b-494e-9862-b4cb7c5a7cda\") " pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.592718 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.592697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-bwpx9" Jul 22 01:45:31.724655 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:31.724627 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bwpx9"] Jul 22 01:45:31.883806 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:31.883775 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5861427e_d30b_494e_9862_b4cb7c5a7cda.slice/crio-a1dcf396142b4b94c5c1f177929577dbc178a726048855d9e44401924486b783 WatchSource:0}: Error finding container a1dcf396142b4b94c5c1f177929577dbc178a726048855d9e44401924486b783: Status 404 returned error can't find the container with id a1dcf396142b4b94c5c1f177929577dbc178a726048855d9e44401924486b783 Jul 22 01:45:32.218479 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.218452 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5vthq_001e6900-63b4-4ea4-a1f6-18e6b0517ce9/serve-healthcheck-canary/0.log" Jul 22 01:45:32.264834 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.264802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-bwpx9" event={"ID":"5861427e-d30b-494e-9862-b4cb7c5a7cda","Type":"ContainerStarted","Data":"62325ac69a39126707fde3152cb6f785663c4a17a037e2b7292e522f5ffbc441"} Jul 22 01:45:32.265038 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.264860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-bwpx9" event={"ID":"5861427e-d30b-494e-9862-b4cb7c5a7cda","Type":"ContainerStarted","Data":"a1dcf396142b4b94c5c1f177929577dbc178a726048855d9e44401924486b783"} Jul 22 01:45:32.266383 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.266361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" event={"ID":"32d30519-6ff4-425b-a7a7-3022f5f5ad5d","Type":"ContainerStarted","Data":"22bfc4362da4705d500593e6e3b3a7226f53770a7de9cd4aab0c8834a504f6f5"} Jul 22 01:45:32.266462 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.266413 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" event={"ID":"32d30519-6ff4-425b-a7a7-3022f5f5ad5d","Type":"ContainerStarted","Data":"cb7a3b322ff6585dbcca61a47b5268fd5215a0904d0a02e7a1b00a1e8ba1acd2"} Jul 22 01:45:32.280915 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.280880 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-bwpx9" podStartSLOduration=1.28086803 podStartE2EDuration="1.28086803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:32.279591603 +0000 UTC m=+51.830805317" watchObservedRunningTime="2026-07-22 01:45:32.28086803 +0000 UTC m=+51.832081743" Jul 22 01:45:32.296269 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.296232 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9lm47" podStartSLOduration=1.5216756729999998 podStartE2EDuration="3.296222473s" totalImagesPullingTime="1.7745468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:32.294591348 +0000 UTC m=+51.845805052" watchObservedRunningTime="2026-07-22 01:45:32.296222473 +0000 UTC m=+51.847436185" Jul 22 01:45:32.712446 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.712410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:32.712619 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:32.712538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:32.712619 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:32.712606 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:45:32.712729 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:32.712623 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 01:45:32.712729 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:32.712682 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:36.712664683 +0000 UTC m=+56.263878375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : configmap "kube-rbac-proxy" not found Jul 22 01:45:32.712729 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:32.712701 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:36.712692408 +0000 UTC m=+56.263906101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : secret "insights-runtime-extractor-tls" not found Jul 22 01:45:33.216436 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:33.216397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:33.216436 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:33.216437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:33.216622 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:33.216488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:33.216622 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216536 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:33.216622 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:33.216548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:33.216622 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216594 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls podName:957a46c5-dbaa-4221-8fd4-2516761a1548 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:49.216580227 +0000 UTC m=+68.767793921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w7kbs" (UID: "957a46c5-dbaa-4221-8fd4-2516761a1548") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:45:33.216622 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:33.216615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216632 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:49.216616924 +0000 UTC m=+68.767830634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : configmap references non-existent config key: service-ca.crt Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216652 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216664 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-89759b74f-xhn7m: secret "image-registry-tls" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216670 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:33.216681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216699 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls podName:a10f0d88-ea23-47cd-8606-d5d9d2e583b1 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:49.2166885 +0000 UTC m=+68.767902196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls") pod "image-registry-89759b74f-xhn7m" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1") : secret "image-registry-tls" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216717 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216739 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216726 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs podName:2191f662-d32f-4565-b920-a3495f5e529d nodeName:}" failed. No retries permitted until 2026-07-22 01:45:49.216717098 +0000 UTC m=+68.767930793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs") pod "router-default-6cff9f6f56-fsz4n" (UID: "2191f662-d32f-4565-b920-a3495f5e529d") : secret "router-metrics-certs-default" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216805 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls podName:209ee414-fb96-40ca-923b-4f5cd09cf320 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:49.216790228 +0000 UTC m=+68.768003934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls") pod "dns-default-svlw6" (UID: "209ee414-fb96-40ca-923b-4f5cd09cf320") : secret "dns-default-metrics-tls" not found Jul 22 01:45:33.216872 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:33.216823 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls podName:cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e nodeName:}" failed. No retries permitted until 2026-07-22 01:45:49.21681426 +0000 UTC m=+68.768027953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4n2g5" (UID: "cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e") : secret "samples-operator-tls" not found Jul 22 01:45:36.748298 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:36.748265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:36.748781 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:36.748331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:36.748781 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:36.748449 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:45:36.748781 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:36.748514 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls podName:8e5c8b14-7e4b-413a-be39-d59acef15c4b nodeName:}" failed. No retries permitted until 2026-07-22 01:45:44.748496487 +0000 UTC m=+64.299710183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9hgn" (UID: "8e5c8b14-7e4b-413a-be39-d59acef15c4b") : secret "insights-runtime-extractor-tls" not found Jul 22 01:45:36.748933 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:36.748914 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e5c8b14-7e4b-413a-be39-d59acef15c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:37.680714 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:37.680679 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:37.680967 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:37.680734 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:37.681081 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:37.681068 2579 scope.go:117] "RemoveContainer" containerID="7cef95ed0a53f2b4de59605a21fd49b34813c74bb2e3cc43300f3e6eddb3b798" Jul 22 01:45:37.681227 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:37.681209 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-8t54x_openshift-console-operator(772900da-da16-4967-a7c6-d802a473d9b8)\"" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" podUID="772900da-da16-4967-a7c6-d802a473d9b8" Jul 22 01:45:44.129199 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:44.129165 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gzvl" Jul 22 01:45:44.817330 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:44.817294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:44.819524 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:44.819497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e5c8b14-7e4b-413a-be39-d59acef15c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9hgn\" (UID: \"8e5c8b14-7e4b-413a-be39-d59acef15c4b\") " pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:44.960502 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:44.960473 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ldh2d\"" Jul 22 01:45:44.968817 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:44.968793 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q9hgn" Jul 22 01:45:45.092412 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.092342 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q9hgn"] Jul 22 01:45:45.095412 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:45.095386 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5c8b14_7e4b_413a_be39_d59acef15c4b.slice/crio-86ec2fa7f32e79551eed67119489dae92c5a81bf76c11929f603166e3d976aaf WatchSource:0}: Error finding container 86ec2fa7f32e79551eed67119489dae92c5a81bf76c11929f603166e3d976aaf: Status 404 returned error can't find the container with id 86ec2fa7f32e79551eed67119489dae92c5a81bf76c11929f603166e3d976aaf Jul 22 01:45:45.311696 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.311661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9hgn" event={"ID":"8e5c8b14-7e4b-413a-be39-d59acef15c4b","Type":"ContainerStarted","Data":"86ec2fa7f32e79551eed67119489dae92c5a81bf76c11929f603166e3d976aaf"} Jul 22 01:45:45.624313 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.623942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:45.626305 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.626279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:45:45.639053 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.638992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa670b94-03c6-4342-95f9-f0d4e6737ebd-metrics-certs\") pod \"network-metrics-daemon-4mwsg\" (UID: \"aa670b94-03c6-4342-95f9-f0d4e6737ebd\") " pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:45.679258 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.679224 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cgfms\"" Jul 22 01:45:45.687951 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.687926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mwsg" Jul 22 01:45:45.725590 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.725555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:45.728068 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.728046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:45:45.738485 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.738463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2412d691-73e5-4f34-a229-5b037e35536c-original-pull-secret\") pod \"global-pull-secret-syncer-w6zb4\" (UID: \"2412d691-73e5-4f34-a229-5b037e35536c\") " pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:45.826679 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.826519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:45.829946 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.829893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j48q\" (UniqueName: \"kubernetes.io/projected/027fc867-c3e5-4706-b75f-e4246eb1f148-kube-api-access-2j48q\") pod \"network-check-target-vdw2x\" (UID: \"027fc867-c3e5-4706-b75f-e4246eb1f148\") " pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:45.857344 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.857296 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4mwsg"] Jul 22 01:45:45.860754 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:45.860704 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa670b94_03c6_4342_95f9_f0d4e6737ebd.slice/crio-6f40418c3a1ab249bd8a7faa9d3e8a2b36ca8ade64916f7e5dd0d920c47f7394 WatchSource:0}: Error finding container 6f40418c3a1ab249bd8a7faa9d3e8a2b36ca8ade64916f7e5dd0d920c47f7394: Status 404 returned error can't find the container with id 6f40418c3a1ab249bd8a7faa9d3e8a2b36ca8ade64916f7e5dd0d920c47f7394 Jul 22 01:45:45.876845 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.876769 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wgwz\"" Jul 22 01:45:45.885376 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.885342 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:45.983725 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:45.983484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6zb4" Jul 22 01:45:46.038476 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.038449 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdw2x"] Jul 22 01:45:46.041931 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:46.041902 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027fc867_c3e5_4706_b75f_e4246eb1f148.slice/crio-997fa5a249bec314ce4125c839f48d397abb83748b907df2d1e8c57cf991d1b6 WatchSource:0}: Error finding container 997fa5a249bec314ce4125c839f48d397abb83748b907df2d1e8c57cf991d1b6: Status 404 returned error can't find the container with id 997fa5a249bec314ce4125c839f48d397abb83748b907df2d1e8c57cf991d1b6 Jul 22 01:45:46.136212 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.136126 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w6zb4"] Jul 22 01:45:46.139848 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:46.139821 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2412d691_73e5_4f34_a229_5b037e35536c.slice/crio-37d9155e51fa1c9639cd6754c003504bf36be76800fd9ab1dbf1f1525f66925e WatchSource:0}: Error finding container 37d9155e51fa1c9639cd6754c003504bf36be76800fd9ab1dbf1f1525f66925e: Status 404 returned error can't find the container with id 37d9155e51fa1c9639cd6754c003504bf36be76800fd9ab1dbf1f1525f66925e Jul 22 01:45:46.320592 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.318843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4mwsg" event={"ID":"aa670b94-03c6-4342-95f9-f0d4e6737ebd","Type":"ContainerStarted","Data":"6f40418c3a1ab249bd8a7faa9d3e8a2b36ca8ade64916f7e5dd0d920c47f7394"} Jul 22 01:45:46.322903 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.322839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w6zb4" event={"ID":"2412d691-73e5-4f34-a229-5b037e35536c","Type":"ContainerStarted","Data":"37d9155e51fa1c9639cd6754c003504bf36be76800fd9ab1dbf1f1525f66925e"} Jul 22 01:45:46.324669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.324636 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdw2x" event={"ID":"027fc867-c3e5-4706-b75f-e4246eb1f148","Type":"ContainerStarted","Data":"ddd1083f91a97eadfc71b4b4306fdcb6260467b0a827785fd8d433d571ad4c19"} Jul 22 01:45:46.324825 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.324680 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdw2x" event={"ID":"027fc867-c3e5-4706-b75f-e4246eb1f148","Type":"ContainerStarted","Data":"997fa5a249bec314ce4125c839f48d397abb83748b907df2d1e8c57cf991d1b6"} Jul 22 01:45:46.324895 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.324821 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:45:46.340782 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:46.340723 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vdw2x" podStartSLOduration=65.34070892 podStartE2EDuration="1m5.34070892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:46.339753306 +0000 UTC m=+65.890967012" watchObservedRunningTime="2026-07-22 01:45:46.34070892 +0000 UTC m=+65.891922637" Jul 22 01:45:47.331263 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:47.331173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4mwsg" event={"ID":"aa670b94-03c6-4342-95f9-f0d4e6737ebd","Type":"ContainerStarted","Data":"8ca8d943d99a17dacb5e6a41e71ad957855ebd3fbf2d1af3318d52a992516f7b"} Jul 22 01:45:47.331263 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:47.331237 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4mwsg" event={"ID":"aa670b94-03c6-4342-95f9-f0d4e6737ebd","Type":"ContainerStarted","Data":"51da20b5bed00eaa81e5ea4a145e85c38ff56e541075641a8baff164d7852408"} Jul 22 01:45:47.356911 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:47.356852 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4mwsg" podStartSLOduration=65.322678313 podStartE2EDuration="1m6.35683058s" totalImagesPullingTime="1.034152267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:47.355278582 +0000 UTC m=+66.906492295" watchObservedRunningTime="2026-07-22 01:45:47.35683058 +0000 UTC m=+66.908044294" Jul 22 01:45:49.257396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.257353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:49.257903 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.257411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:49.257903 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.257446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:49.257903 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.257472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:49.257903 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.257498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:49.257903 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.257552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:49.258361 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.258309 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2191f662-d32f-4565-b920-a3495f5e529d-service-ca-bundle\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:49.260331 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.260300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2191f662-d32f-4565-b920-a3495f5e529d-metrics-certs\") pod \"router-default-6cff9f6f56-fsz4n\" (UID: \"2191f662-d32f-4565-b920-a3495f5e529d\") " pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:49.260441 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.260403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4n2g5\" (UID: \"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:49.260569 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.260547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"image-registry-89759b74f-xhn7m\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:49.260641 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.260622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/957a46c5-dbaa-4221-8fd4-2516761a1548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w7kbs\" (UID: \"957a46c5-dbaa-4221-8fd4-2516761a1548\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:49.260698 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.260676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/209ee414-fb96-40ca-923b-4f5cd09cf320-metrics-tls\") pod \"dns-default-svlw6\" (UID: \"209ee414-fb96-40ca-923b-4f5cd09cf320\") " pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:49.419101 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.419061 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fkbgh\"" Jul 22 01:45:49.427786 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.427759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" Jul 22 01:45:49.439248 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.438927 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bdp9b\"" Jul 22 01:45:49.447577 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.447557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" Jul 22 01:45:49.461390 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.461366 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4nrgv\"" Jul 22 01:45:49.468882 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.468861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-86kzc\"" Jul 22 01:45:49.469901 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.469886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:49.477539 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.477510 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:49.502402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.502252 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nz6sc\"" Jul 22 01:45:49.510913 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:49.510859 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:51.965212 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:51.965181 2579 scope.go:117] "RemoveContainer" containerID="7cef95ed0a53f2b4de59605a21fd49b34813c74bb2e3cc43300f3e6eddb3b798" Jul 22 01:45:52.197428 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.196997 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs"] Jul 22 01:45:52.204972 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:52.203867 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957a46c5_dbaa_4221_8fd4_2516761a1548.slice/crio-40322bbb4a69966c1984daf48d0bbeda1b8f06d36269b7873cae96701c0c8ade WatchSource:0}: Error finding container 40322bbb4a69966c1984daf48d0bbeda1b8f06d36269b7873cae96701c0c8ade: Status 404 returned error can't find the container with id 40322bbb4a69966c1984daf48d0bbeda1b8f06d36269b7873cae96701c0c8ade Jul 22 01:45:52.232354 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.231006 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-89759b74f-xhn7m"] Jul 22 01:45:52.257447 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.257351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svlw6"] Jul 22 01:45:52.260779 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:52.260730 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209ee414_fb96_40ca_923b_4f5cd09cf320.slice/crio-7c2859add3b256a493abf7bcfe1240ca7a16421ca4deb3548b7fc57e71cf0c3d WatchSource:0}: Error finding container 7c2859add3b256a493abf7bcfe1240ca7a16421ca4deb3548b7fc57e71cf0c3d: Status 404 returned error can't find the container with id 7c2859add3b256a493abf7bcfe1240ca7a16421ca4deb3548b7fc57e71cf0c3d Jul 22 01:45:52.276495 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.276469 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5"] Jul 22 01:45:52.301772 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.301705 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cff9f6f56-fsz4n"] Jul 22 01:45:52.306069 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:52.306044 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2191f662_d32f_4565_b920_a3495f5e529d.slice/crio-3e768c8f8b1ce00b2497f0a2b648c1c7b4f194572c79137a96a166a66824d53a WatchSource:0}: Error finding container 3e768c8f8b1ce00b2497f0a2b648c1c7b4f194572c79137a96a166a66824d53a: Status 404 returned error can't find the container with id 3e768c8f8b1ce00b2497f0a2b648c1c7b4f194572c79137a96a166a66824d53a Jul 22 01:45:52.355127 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.355096 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9hgn" event={"ID":"8e5c8b14-7e4b-413a-be39-d59acef15c4b","Type":"ContainerStarted","Data":"36110d8f47f9433c34ef5b7a443d8841b654be9a56da2623efd4e8e300bfee57"} Jul 22 01:45:52.356709 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.356680 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" event={"ID":"a10f0d88-ea23-47cd-8606-d5d9d2e583b1","Type":"ContainerStarted","Data":"757eb59a0d9a86e1ce949727253b1f7ddd3da71b5b6f9aa95e591691693f6f66"} Jul 22 01:45:52.356856 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.356729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" event={"ID":"a10f0d88-ea23-47cd-8606-d5d9d2e583b1","Type":"ContainerStarted","Data":"7f7730a7a8e132059c96686d6d7c8842f1c01e893bcdab856a7ec2742bf5d873"} Jul 22 01:45:52.356856 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.356800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:45:52.364824 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.363030 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:45:52.364824 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.363127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" event={"ID":"772900da-da16-4967-a7c6-d802a473d9b8","Type":"ContainerStarted","Data":"af13b77ea6ca374d8f010a1267e861f23fac7b5b9c7b29e0bc856a214a17ba21"} Jul 22 01:45:52.364824 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.363798 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:52.368083 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.367581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w6zb4" event={"ID":"2412d691-73e5-4f34-a229-5b037e35536c","Type":"ContainerStarted","Data":"f0cd107b4ae1ce9d0a47ba55ee5e954c29d4feb4771342a54d974ee182b65592"} Jul 22 01:45:52.372241 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.369968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" event={"ID":"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e","Type":"ContainerStarted","Data":"238cb6a3bf6550870ac36b6d52c795afba23f21970b3e5f03c194a918b4b5881"} Jul 22 01:45:52.372241 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.372204 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" event={"ID":"2191f662-d32f-4565-b920-a3495f5e529d","Type":"ContainerStarted","Data":"3e768c8f8b1ce00b2497f0a2b648c1c7b4f194572c79137a96a166a66824d53a"} Jul 22 01:45:52.374094 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.374000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svlw6" event={"ID":"209ee414-fb96-40ca-923b-4f5cd09cf320","Type":"ContainerStarted","Data":"7c2859add3b256a493abf7bcfe1240ca7a16421ca4deb3548b7fc57e71cf0c3d"} Jul 22 01:45:52.376054 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.375654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" event={"ID":"957a46c5-dbaa-4221-8fd4-2516761a1548","Type":"ContainerStarted","Data":"40322bbb4a69966c1984daf48d0bbeda1b8f06d36269b7873cae96701c0c8ade"} Jul 22 01:45:52.377653 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.376502 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" podStartSLOduration=70.376484485 podStartE2EDuration="1m10.376484485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:52.375383907 +0000 UTC m=+71.926597621" watchObservedRunningTime="2026-07-22 01:45:52.376484485 +0000 UTC m=+71.927698200" Jul 22 01:45:52.391264 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.391199 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" podStartSLOduration=42.613836458 podStartE2EDuration="50.391182555s" totalImagesPullingTime="7.777346097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:52.389650366 +0000 UTC m=+71.940864083" watchObservedRunningTime="2026-07-22 01:45:52.391182555 +0000 UTC m=+71.942396269" Jul 22 01:45:52.404544 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.404505 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w6zb4" podStartSLOduration=64.538371385 podStartE2EDuration="1m10.404492609s" totalImagesPullingTime="5.866121224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:52.403171032 +0000 UTC m=+71.954384737" watchObservedRunningTime="2026-07-22 01:45:52.404492609 +0000 UTC m=+71.955706337" Jul 22 01:45:52.424441 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.424390 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" podStartSLOduration=54.424372498 podStartE2EDuration="54.424372498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:52.422645606 +0000 UTC m=+71.973859318" watchObservedRunningTime="2026-07-22 01:45:52.424372498 +0000 UTC m=+71.975586211" Jul 22 01:45:52.470339 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.470266 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:52.472714 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.472685 2579 patch_prober.go:28] interesting pod/router-default-6cff9f6f56-fsz4n container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 22 01:45:52.472714 ip-10-0-141-12 kubenswrapper[2579]: [-]has-synced failed: reason withheld Jul 22 01:45:52.472714 ip-10-0-141-12 kubenswrapper[2579]: [+]process-running ok Jul 22 01:45:52.472714 ip-10-0-141-12 kubenswrapper[2579]: healthz check failed Jul 22 01:45:52.472987 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.472780 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" podUID="2191f662-d32f-4565-b920-a3495f5e529d" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 22 01:45:52.505163 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:52.505136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-8t54x" Jul 22 01:45:53.388050 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:53.388011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" event={"ID":"2191f662-d32f-4565-b920-a3495f5e529d","Type":"ContainerStarted","Data":"2e7c323e4d4005ad497332cd9954fdb2c0cddcaf57c16d3099c940513c1ea7d8"} Jul 22 01:45:53.472489 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:53.472238 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:54.212021 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.211989 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d"] Jul 22 01:45:54.215505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.215478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.218377 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.218349 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 01:45:54.219005 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.218891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2ckrf\"" Jul 22 01:45:54.219005 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.218911 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 01:45:54.229524 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.229498 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d"] Jul 22 01:45:54.314982 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.314946 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-b6nlr"] Jul 22 01:45:54.318071 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.318034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a48b484-5451-4460-8cf5-fd2479a239be-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nvw6d\" (UID: \"0a48b484-5451-4460-8cf5-fd2479a239be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.318256 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.318132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a48b484-5451-4460-8cf5-fd2479a239be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nvw6d\" (UID: \"0a48b484-5451-4460-8cf5-fd2479a239be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.318388 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.318371 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-b6nlr" Jul 22 01:45:54.322138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.322104 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 01:45:54.322480 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.322460 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-799f4\"" Jul 22 01:45:54.322589 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.322510 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 01:45:54.329198 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.329171 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-b6nlr"] Jul 22 01:45:54.393963 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.393897 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:54.395553 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.395527 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6cff9f6f56-fsz4n" Jul 22 01:45:54.419507 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.419478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a48b484-5451-4460-8cf5-fd2479a239be-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nvw6d\" (UID: \"0a48b484-5451-4460-8cf5-fd2479a239be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.419680 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.419525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7bd8\" (UniqueName: \"kubernetes.io/projected/a39cad57-466c-470b-8a19-a2ba571ac438-kube-api-access-s7bd8\") pod \"downloads-5bc67dcd46-b6nlr\" (UID: \"a39cad57-466c-470b-8a19-a2ba571ac438\") " pod="openshift-console/downloads-5bc67dcd46-b6nlr" Jul 22 01:45:54.419680 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.419636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a48b484-5451-4460-8cf5-fd2479a239be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nvw6d\" (UID: \"0a48b484-5451-4460-8cf5-fd2479a239be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.421315 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.421207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a48b484-5451-4460-8cf5-fd2479a239be-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nvw6d\" (UID: \"0a48b484-5451-4460-8cf5-fd2479a239be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.423038 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.422935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a48b484-5451-4460-8cf5-fd2479a239be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nvw6d\" (UID: \"0a48b484-5451-4460-8cf5-fd2479a239be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.522197 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.521856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7bd8\" (UniqueName: \"kubernetes.io/projected/a39cad57-466c-470b-8a19-a2ba571ac438-kube-api-access-s7bd8\") pod \"downloads-5bc67dcd46-b6nlr\" (UID: \"a39cad57-466c-470b-8a19-a2ba571ac438\") " pod="openshift-console/downloads-5bc67dcd46-b6nlr" Jul 22 01:45:54.527671 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.527642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" Jul 22 01:45:54.536426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.535280 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7bd8\" (UniqueName: \"kubernetes.io/projected/a39cad57-466c-470b-8a19-a2ba571ac438-kube-api-access-s7bd8\") pod \"downloads-5bc67dcd46-b6nlr\" (UID: \"a39cad57-466c-470b-8a19-a2ba571ac438\") " pod="openshift-console/downloads-5bc67dcd46-b6nlr" Jul 22 01:45:54.629719 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:54.629641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-b6nlr" Jul 22 01:45:57.379978 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.379798 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-b6nlr"] Jul 22 01:45:57.385570 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:57.385329 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39cad57_466c_470b_8a19_a2ba571ac438.slice/crio-a2c9af2dac74c9818b294e7d9d2218e425eeb2641272511a6b9864ac26b6c406 WatchSource:0}: Error finding container a2c9af2dac74c9818b294e7d9d2218e425eeb2641272511a6b9864ac26b6c406: Status 404 returned error can't find the container with id a2c9af2dac74c9818b294e7d9d2218e425eeb2641272511a6b9864ac26b6c406 Jul 22 01:45:57.407469 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.407434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-b6nlr" event={"ID":"a39cad57-466c-470b-8a19-a2ba571ac438","Type":"ContainerStarted","Data":"a2c9af2dac74c9818b294e7d9d2218e425eeb2641272511a6b9864ac26b6c406"} Jul 22 01:45:57.506307 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.506255 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d"] Jul 22 01:45:57.511882 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:57.511854 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a48b484_5451_4460_8cf5_fd2479a239be.slice/crio-853c251f0ff2ca848167a5f3dae9f2d86f4c277623383f87f7ad85f6f4050718 WatchSource:0}: Error finding container 853c251f0ff2ca848167a5f3dae9f2d86f4c277623383f87f7ad85f6f4050718: Status 404 returned error can't find the container with id 853c251f0ff2ca848167a5f3dae9f2d86f4c277623383f87f7ad85f6f4050718 Jul 22 01:45:57.910030 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.909996 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2"] Jul 22 01:45:57.924009 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.923973 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2"] Jul 22 01:45:57.924197 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.924085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:45:57.926434 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.926408 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 22 01:45:57.926586 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:57.926538 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ql4w6\"" Jul 22 01:45:58.057991 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.057952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5afa9743-099d-463d-bb7b-ab1cfd3fb0b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9f9k2\" (UID: \"5afa9743-099d-463d-bb7b-ab1cfd3fb0b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:45:58.159503 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.159374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5afa9743-099d-463d-bb7b-ab1cfd3fb0b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9f9k2\" (UID: \"5afa9743-099d-463d-bb7b-ab1cfd3fb0b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:45:58.159660 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:58.159505 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 22 01:45:58.159660 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:45:58.159588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5afa9743-099d-463d-bb7b-ab1cfd3fb0b9-tls-certificates podName:5afa9743-099d-463d-bb7b-ab1cfd3fb0b9 nodeName:}" failed. No retries permitted until 2026-07-22 01:45:58.659565402 +0000 UTC m=+78.210779093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5afa9743-099d-463d-bb7b-ab1cfd3fb0b9-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-9f9k2" (UID: "5afa9743-099d-463d-bb7b-ab1cfd3fb0b9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 22 01:45:58.415676 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.415591 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" event={"ID":"0a48b484-5451-4460-8cf5-fd2479a239be","Type":"ContainerStarted","Data":"853c251f0ff2ca848167a5f3dae9f2d86f4c277623383f87f7ad85f6f4050718"} Jul 22 01:45:58.418501 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.418305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" event={"ID":"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e","Type":"ContainerStarted","Data":"6359905c00393959cf9c081c3bc242f7ba6dc95d1d2b8b91b8c21137f5d303b6"} Jul 22 01:45:58.418501 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.418354 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" event={"ID":"cf6ffa3f-7cf9-4eec-a8b2-5a1e87c8e22e","Type":"ContainerStarted","Data":"3454edc7d32d6f23339cdc8888836a43672a1ac6f3441be3d36d3356f6a2c6fa"} Jul 22 01:45:58.423432 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.423282 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svlw6" event={"ID":"209ee414-fb96-40ca-923b-4f5cd09cf320","Type":"ContainerStarted","Data":"5a6754a041e11596cf3248e71a3be301c25219c94786122e47a2dd569c2d077c"} Jul 22 01:45:58.423432 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.423329 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-svlw6" Jul 22 01:45:58.423432 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.423355 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svlw6" event={"ID":"209ee414-fb96-40ca-923b-4f5cd09cf320","Type":"ContainerStarted","Data":"9f84d3ee52b8e22a676601fb635398aa14153d32bdcc7d5a7270a8aabe6ded91"} Jul 22 01:45:58.425512 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.425488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" event={"ID":"957a46c5-dbaa-4221-8fd4-2516761a1548","Type":"ContainerStarted","Data":"5c3b8d1e1e4403133a06b3d66230ff110063d24dbdda0e2f259876982a39d2dc"} Jul 22 01:45:58.429830 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.429767 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9hgn" event={"ID":"8e5c8b14-7e4b-413a-be39-d59acef15c4b","Type":"ContainerStarted","Data":"173603e241172b38eb9b237b0962a505eea8dd480b5caa6d23edbf5623ef9830"} Jul 22 01:45:58.434557 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.434442 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4n2g5" podStartSLOduration=52.399998342 podStartE2EDuration="57.434423859s" totalImagesPullingTime="5.034425517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:58.433625118 +0000 UTC m=+77.984838834" watchObservedRunningTime="2026-07-22 01:45:58.434423859 +0000 UTC m=+77.985637574" Jul 22 01:45:58.453528 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.452673 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-svlw6" podStartSLOduration=36.348879687 podStartE2EDuration="41.452654804s" totalImagesPullingTime="5.103775117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:58.452248811 +0000 UTC m=+78.003462525" watchObservedRunningTime="2026-07-22 01:45:58.452654804 +0000 UTC m=+78.003868518" Jul 22 01:45:58.468052 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.467933 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w7kbs" podStartSLOduration=55.430164202 podStartE2EDuration="1m0.467915573s" totalImagesPullingTime="5.037751371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:45:58.466490936 +0000 UTC m=+78.017704650" watchObservedRunningTime="2026-07-22 01:45:58.467915573 +0000 UTC m=+78.019129287" Jul 22 01:45:58.663406 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.663367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5afa9743-099d-463d-bb7b-ab1cfd3fb0b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9f9k2\" (UID: \"5afa9743-099d-463d-bb7b-ab1cfd3fb0b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:45:58.666386 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.666298 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5afa9743-099d-463d-bb7b-ab1cfd3fb0b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9f9k2\" (UID: \"5afa9743-099d-463d-bb7b-ab1cfd3fb0b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:45:58.835568 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:58.835527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:45:59.309611 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:59.309577 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2"] Jul 22 01:45:59.313436 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:45:59.313402 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afa9743_099d_463d_bb7b_ab1cfd3fb0b9.slice/crio-ce7eaebb5fed933c28b97d28ed4d442336bd4aae204fb060f8f786ed1f602c99 WatchSource:0}: Error finding container ce7eaebb5fed933c28b97d28ed4d442336bd4aae204fb060f8f786ed1f602c99: Status 404 returned error can't find the container with id ce7eaebb5fed933c28b97d28ed4d442336bd4aae204fb060f8f786ed1f602c99 Jul 22 01:45:59.436189 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:45:59.436099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" event={"ID":"5afa9743-099d-463d-bb7b-ab1cfd3fb0b9","Type":"ContainerStarted","Data":"ce7eaebb5fed933c28b97d28ed4d442336bd4aae204fb060f8f786ed1f602c99"} Jul 22 01:46:00.443321 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:00.443278 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" event={"ID":"0a48b484-5451-4460-8cf5-fd2479a239be","Type":"ContainerStarted","Data":"febc9ace7ec387ff11d4de548aa9ca509d043e0df8f8f69472b29c7ec52a6fde"} Jul 22 01:46:00.461778 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:00.461702 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nvw6d" podStartSLOduration=4.439812809 podStartE2EDuration="6.461679392s" totalImagesPullingTime="2.021866583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:46:00.460384257 +0000 UTC m=+80.011597971" watchObservedRunningTime="2026-07-22 01:46:00.461679392 +0000 UTC m=+80.012893110" Jul 22 01:46:03.460415 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:03.460230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9hgn" event={"ID":"8e5c8b14-7e4b-413a-be39-d59acef15c4b","Type":"ContainerStarted","Data":"bc4a74883ca9b8eec8395eba5ad90ba08d6b7327acd3aa620bf1258a0cb09143"} Jul 22 01:46:03.462158 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:03.462123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" event={"ID":"5afa9743-099d-463d-bb7b-ab1cfd3fb0b9","Type":"ContainerStarted","Data":"1abe5e4e50d320171794179a8926d53e3d45e8f7b6d9c21b163a12cbcf30bc1d"} Jul 22 01:46:03.462371 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:03.462344 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:46:03.467895 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:03.467872 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" Jul 22 01:46:03.479009 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:03.478621 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q9hgn" podStartSLOduration=17.042755782 podStartE2EDuration="34.478604185s" totalImagesPullingTime="17.435848403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:45:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:46:03.476717 +0000 UTC m=+83.027930717" watchObservedRunningTime="2026-07-22 01:46:03.478604185 +0000 UTC m=+83.029817899" Jul 22 01:46:03.491175 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:03.491120 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9f9k2" podStartSLOduration=2.970463612 podStartE2EDuration="6.491096641s" totalImagesPullingTime="3.520633029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:46:03.490173038 +0000 UTC m=+83.041386764" watchObservedRunningTime="2026-07-22 01:46:03.491096641 +0000 UTC m=+83.042310354" Jul 22 01:46:08.438311 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:08.438279 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-svlw6" Jul 22 01:46:13.394480 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:13.394446 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:46:15.339057 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.338978 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7k5s8"] Jul 22 01:46:15.346511 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.346481 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.350179 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.349343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 01:46:15.350179 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.349616 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p24dd\"" Jul 22 01:46:15.350179 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.349856 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 01:46:15.350179 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.350041 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 01:46:15.350456 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.350292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 01:46:15.408523 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5vg2\" (UniqueName: \"kubernetes.io/projected/7c241f74-2e80-4b36-9daa-ca1872c83354-kube-api-access-f5vg2\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408523 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-tls\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408738 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-sys\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408738 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-root\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408738 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408738 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-textfile\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408738 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408738 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c241f74-2e80-4b36-9daa-ca1872c83354-metrics-client-ca\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.408738 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.408729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-wtmp\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.509893 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.509852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-wtmp\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510058 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.509920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5vg2\" (UniqueName: \"kubernetes.io/projected/7c241f74-2e80-4b36-9daa-ca1872c83354-kube-api-access-f5vg2\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510058 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.509956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-tls\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510058 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.509987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-sys\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510058 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.510012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-root\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510058 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.510039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510324 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.510069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-textfile\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510324 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.510095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510324 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.510119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c241f74-2e80-4b36-9daa-ca1872c83354-metrics-client-ca\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510767 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.510723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c241f74-2e80-4b36-9daa-ca1872c83354-metrics-client-ca\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.510907 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.510889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-wtmp\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.511270 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:46:15.511252 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 01:46:15.511339 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:46:15.511314 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-tls podName:7c241f74-2e80-4b36-9daa-ca1872c83354 nodeName:}" failed. No retries permitted until 2026-07-22 01:46:16.011296858 +0000 UTC m=+95.562510554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-tls") pod "node-exporter-7k5s8" (UID: "7c241f74-2e80-4b36-9daa-ca1872c83354") : secret "node-exporter-tls" not found Jul 22 01:46:15.511495 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.511476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-sys\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.511571 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.511527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c241f74-2e80-4b36-9daa-ca1872c83354-root\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.512075 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.512040 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.512185 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.512141 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-textfile\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.520383 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.514702 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.524618 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.524550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5vg2\" (UniqueName: \"kubernetes.io/projected/7c241f74-2e80-4b36-9daa-ca1872c83354-kube-api-access-f5vg2\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:15.526397 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.526372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-b6nlr" event={"ID":"a39cad57-466c-470b-8a19-a2ba571ac438","Type":"ContainerStarted","Data":"ac76f7a60177a39eea123160fa2cfcb693e74fc2825b20a838a85bc2bb0f23e0"} Jul 22 01:46:15.527637 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.527619 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-b6nlr" Jul 22 01:46:15.528971 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.528629 2579 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-b6nlr container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.22:8080/\": dial tcp 10.132.0.22:8080: connect: connection refused" start-of-body= Jul 22 01:46:15.528971 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.528673 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-b6nlr" podUID="a39cad57-466c-470b-8a19-a2ba571ac438" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.22:8080/\": dial tcp 10.132.0.22:8080: connect: connection refused" Jul 22 01:46:15.545134 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:15.545083 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-b6nlr" podStartSLOduration=3.85958853 podStartE2EDuration="21.545047612s" totalImagesPullingTime="17.685459082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:46:15.543823191 +0000 UTC m=+95.095036904" watchObservedRunningTime="2026-07-22 01:46:15.545047612 +0000 UTC m=+95.096261325" Jul 22 01:46:16.014764 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:16.014709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-tls\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:16.017535 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:16.017507 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c241f74-2e80-4b36-9daa-ca1872c83354-node-exporter-tls\") pod \"node-exporter-7k5s8\" (UID: \"7c241f74-2e80-4b36-9daa-ca1872c83354\") " pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:16.259892 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:16.259860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7k5s8" Jul 22 01:46:16.304650 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:46:16.304619 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c241f74_2e80_4b36_9daa_ca1872c83354.slice/crio-e5c0d466d3b3686bf1bfce1932b9dcb626fe03aaea892668d24d3b86b60a7093 WatchSource:0}: Error finding container e5c0d466d3b3686bf1bfce1932b9dcb626fe03aaea892668d24d3b86b60a7093: Status 404 returned error can't find the container with id e5c0d466d3b3686bf1bfce1932b9dcb626fe03aaea892668d24d3b86b60a7093 Jul 22 01:46:16.460880 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:16.460796 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-89759b74f-xhn7m"] Jul 22 01:46:16.534585 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:16.534044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k5s8" event={"ID":"7c241f74-2e80-4b36-9daa-ca1872c83354","Type":"ContainerStarted","Data":"e5c0d466d3b3686bf1bfce1932b9dcb626fe03aaea892668d24d3b86b60a7093"} Jul 22 01:46:16.551574 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:16.551488 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-b6nlr" Jul 22 01:46:17.334107 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:17.334073 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vdw2x" Jul 22 01:46:18.544049 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:18.543964 2579 generic.go:356] "Generic (PLEG): container finished" podID="7c241f74-2e80-4b36-9daa-ca1872c83354" containerID="fa99b4c49ccb47df5e57a3e4808b00b52252a0391c69472be50276f4e246de71" exitCode=0 Jul 22 01:46:18.544508 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:18.544053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k5s8" event={"ID":"7c241f74-2e80-4b36-9daa-ca1872c83354","Type":"ContainerDied","Data":"fa99b4c49ccb47df5e57a3e4808b00b52252a0391c69472be50276f4e246de71"} Jul 22 01:46:19.551154 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:19.551106 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k5s8" event={"ID":"7c241f74-2e80-4b36-9daa-ca1872c83354","Type":"ContainerStarted","Data":"f55fd1f8dbfd02b008f2033f79d07794cf2090299954cebb170d1a75b941b131"} Jul 22 01:46:19.551593 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:19.551175 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k5s8" event={"ID":"7c241f74-2e80-4b36-9daa-ca1872c83354","Type":"ContainerStarted","Data":"3347e116c164c001c6fd849a33680e03c5af115b5386a00c152ce38a94d8ac17"} Jul 22 01:46:19.571521 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:19.571476 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7k5s8" podStartSLOduration=2.8145575210000002 podStartE2EDuration="4.571460167s" totalImagesPullingTime="1.649039732s" totalInitContainerRuntime="107.862914ms" isStatefulPod=true podCreationTimestamp="2026-07-22 01:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:46:19.569101754 +0000 UTC m=+99.120315480" watchObservedRunningTime="2026-07-22 01:46:19.571460167 +0000 UTC m=+99.122673879" Jul 22 01:46:39.635981 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:39.635943 2579 generic.go:356] "Generic (PLEG): container finished" podID="52496b90-523c-4e08-8d41-ef086da087a5" containerID="b9194b0e0b12c3c4f2091bb37e12ff8dec49122582127217ec906da145acab63" exitCode=0 Jul 22 01:46:39.636433 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:39.636015 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" event={"ID":"52496b90-523c-4e08-8d41-ef086da087a5","Type":"ContainerDied","Data":"b9194b0e0b12c3c4f2091bb37e12ff8dec49122582127217ec906da145acab63"} Jul 22 01:46:39.636433 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:39.636318 2579 scope.go:117] "RemoveContainer" containerID="b9194b0e0b12c3c4f2091bb37e12ff8dec49122582127217ec906da145acab63" Jul 22 01:46:40.641351 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:40.641315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8cckv" event={"ID":"52496b90-523c-4e08-8d41-ef086da087a5","Type":"ContainerStarted","Data":"f43d75f6180757395ad25210cc63669e76d5b570d0722166378430ce92099f3d"} Jul 22 01:46:41.491612 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.491554 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" podUID="a10f0d88-ea23-47cd-8606-d5d9d2e583b1" containerName="registry" containerID="cri-o://757eb59a0d9a86e1ce949727253b1f7ddd3da71b5b6f9aa95e591691693f6f66" gracePeriod=30 Jul 22 01:46:41.646845 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.646814 2579 generic.go:356] "Generic (PLEG): container finished" podID="a10f0d88-ea23-47cd-8606-d5d9d2e583b1" containerID="757eb59a0d9a86e1ce949727253b1f7ddd3da71b5b6f9aa95e591691693f6f66" exitCode=0 Jul 22 01:46:41.647146 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.646879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" event={"ID":"a10f0d88-ea23-47cd-8606-d5d9d2e583b1","Type":"ContainerDied","Data":"757eb59a0d9a86e1ce949727253b1f7ddd3da71b5b6f9aa95e591691693f6f66"} Jul 22 01:46:41.781899 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.781871 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:46:41.926121 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926095 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-ca-trust-extracted\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926257 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926140 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz47m\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-kube-api-access-tz47m\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926257 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926174 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-trusted-ca\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926257 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926198 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-certificates\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926257 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926230 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-installation-pull-secrets\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926441 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926260 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926441 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926291 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-bound-sa-token\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926441 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926332 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-image-registry-private-configuration\") pod \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\" (UID: \"a10f0d88-ea23-47cd-8606-d5d9d2e583b1\") " Jul 22 01:46:41.926660 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926626 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:46:41.926811 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.926639 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:46:41.928907 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.928877 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:46:41.929015 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.928948 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:46:41.929076 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.929025 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:46:41.929447 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.929419 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:46:41.929693 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.929672 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-kube-api-access-tz47m" (OuterVolumeSpecName: "kube-api-access-tz47m") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "kube-api-access-tz47m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:46:41.934417 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:41.934391 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a10f0d88-ea23-47cd-8606-d5d9d2e583b1" (UID: "a10f0d88-ea23-47cd-8606-d5d9d2e583b1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:46:42.027467 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027410 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz47m\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-kube-api-access-tz47m\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.027467 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027432 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-trusted-ca\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.027467 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027442 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-certificates\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.027467 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027450 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-installation-pull-secrets\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.027467 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027459 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-registry-tls\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.027467 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027466 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-bound-sa-token\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.027693 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027475 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-image-registry-private-configuration\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.027693 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.027485 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a10f0d88-ea23-47cd-8606-d5d9d2e583b1-ca-trust-extracted\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:46:42.652358 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.652331 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" Jul 22 01:46:42.652358 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.652338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89759b74f-xhn7m" event={"ID":"a10f0d88-ea23-47cd-8606-d5d9d2e583b1","Type":"ContainerDied","Data":"7f7730a7a8e132059c96686d6d7c8842f1c01e893bcdab856a7ec2742bf5d873"} Jul 22 01:46:42.652844 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.652388 2579 scope.go:117] "RemoveContainer" containerID="757eb59a0d9a86e1ce949727253b1f7ddd3da71b5b6f9aa95e591691693f6f66" Jul 22 01:46:42.679343 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.678288 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-89759b74f-xhn7m"] Jul 22 01:46:42.686219 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.686197 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-89759b74f-xhn7m"] Jul 22 01:46:42.969388 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:42.969319 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a10f0d88-ea23-47cd-8606-d5d9d2e583b1" path="/var/lib/kubelet/pods/a10f0d88-ea23-47cd-8606-d5d9d2e583b1/volumes" Jul 22 01:46:43.657835 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:43.657763 2579 generic.go:356] "Generic (PLEG): container finished" podID="1311591e-2c35-42cc-9911-9b536a652a9e" containerID="ab8483de31bd1cfcf49e7bed184b5384247992d355d32f4c5111762ac398675a" exitCode=0 Jul 22 01:46:43.657835 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:43.657817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c8rqz" event={"ID":"1311591e-2c35-42cc-9911-9b536a652a9e","Type":"ContainerDied","Data":"ab8483de31bd1cfcf49e7bed184b5384247992d355d32f4c5111762ac398675a"} Jul 22 01:46:43.658261 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:43.658144 2579 scope.go:117] "RemoveContainer" containerID="ab8483de31bd1cfcf49e7bed184b5384247992d355d32f4c5111762ac398675a" Jul 22 01:46:44.664244 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:44.664210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c8rqz" event={"ID":"1311591e-2c35-42cc-9911-9b536a652a9e","Type":"ContainerStarted","Data":"d0a1f4ad1d4973bafa423246d7b90a5601e9f0ce36506bf114a511c8388e82b6"} Jul 22 01:46:58.723064 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:58.722984 2579 generic.go:356] "Generic (PLEG): container finished" podID="593d01bf-b1ff-4bdd-af20-3f7281ae483c" containerID="8d835f354bf48a480e5b49d91cdc1568f76cd36707dd5704c51785b4226dd187" exitCode=0 Jul 22 01:46:58.723064 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:58.723051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" event={"ID":"593d01bf-b1ff-4bdd-af20-3f7281ae483c","Type":"ContainerDied","Data":"8d835f354bf48a480e5b49d91cdc1568f76cd36707dd5704c51785b4226dd187"} Jul 22 01:46:58.723471 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:58.723345 2579 scope.go:117] "RemoveContainer" containerID="8d835f354bf48a480e5b49d91cdc1568f76cd36707dd5704c51785b4226dd187" Jul 22 01:46:59.728754 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:46:59.728721 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rzwq9" event={"ID":"593d01bf-b1ff-4bdd-af20-3f7281ae483c","Type":"ContainerStarted","Data":"44fc2a2f651b9c36a39f617dc5367513ecb70ae2148169ea0e3b5668f13b2439"} Jul 22 01:48:16.071499 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.071459 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p"] Jul 22 01:48:16.072103 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.071902 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10f0d88-ea23-47cd-8606-d5d9d2e583b1" containerName="registry" Jul 22 01:48:16.072103 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.071921 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10f0d88-ea23-47cd-8606-d5d9d2e583b1" containerName="registry" Jul 22 01:48:16.072103 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.072018 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a10f0d88-ea23-47cd-8606-d5d9d2e583b1" containerName="registry" Jul 22 01:48:16.075177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.075154 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.077275 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.077256 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:48:16.077865 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.077849 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:48:16.077935 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.077909 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xlhh\"" Jul 22 01:48:16.082396 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.082372 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p"] Jul 22 01:48:16.194961 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.194922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.195127 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.194988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbx9k\" (UniqueName: \"kubernetes.io/projected/6ee9b7ef-60ad-47ed-b947-57c47a918363-kube-api-access-xbx9k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.195127 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.195021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.296352 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.296299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.296530 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.296372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbx9k\" (UniqueName: \"kubernetes.io/projected/6ee9b7ef-60ad-47ed-b947-57c47a918363-kube-api-access-xbx9k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.296530 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.296404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.296689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.296667 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.296787 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.296733 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.304619 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.304594 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbx9k\" (UniqueName: \"kubernetes.io/projected/6ee9b7ef-60ad-47ed-b947-57c47a918363-kube-api-access-xbx9k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.385330 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.385293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:16.511012 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:16.510822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p"] Jul 22 01:48:16.513690 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:48:16.513663 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee9b7ef_60ad_47ed_b947_57c47a918363.slice/crio-da825b71030539b13b04f75ebcadc1594b765f5bfa44c7ce08b7e8abab80da09 WatchSource:0}: Error finding container da825b71030539b13b04f75ebcadc1594b765f5bfa44c7ce08b7e8abab80da09: Status 404 returned error can't find the container with id da825b71030539b13b04f75ebcadc1594b765f5bfa44c7ce08b7e8abab80da09 Jul 22 01:48:17.021156 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:17.021118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" event={"ID":"6ee9b7ef-60ad-47ed-b947-57c47a918363","Type":"ContainerStarted","Data":"da825b71030539b13b04f75ebcadc1594b765f5bfa44c7ce08b7e8abab80da09"} Jul 22 01:48:24.050281 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:24.050248 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerID="4b99020de866010cc7385129df7bbc1a309a979cf3a758096cfc182ddf5268ab" exitCode=0 Jul 22 01:48:24.050670 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:24.050337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" event={"ID":"6ee9b7ef-60ad-47ed-b947-57c47a918363","Type":"ContainerDied","Data":"4b99020de866010cc7385129df7bbc1a309a979cf3a758096cfc182ddf5268ab"} Jul 22 01:48:26.059468 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:26.059438 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerID="7d65bc76e3ae70907becd6dc3a3153038a0b79e2c341ce8c26950f303ad1f4c7" exitCode=0 Jul 22 01:48:26.059780 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:26.059509 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" event={"ID":"6ee9b7ef-60ad-47ed-b947-57c47a918363","Type":"ContainerDied","Data":"7d65bc76e3ae70907becd6dc3a3153038a0b79e2c341ce8c26950f303ad1f4c7"} Jul 22 01:48:34.094363 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:34.094331 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerID="6c91de176890a3885139220bbf03d63ce45afb84b28cb485a704e35fbf68b9f3" exitCode=0 Jul 22 01:48:34.094704 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:34.094423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" event={"ID":"6ee9b7ef-60ad-47ed-b947-57c47a918363","Type":"ContainerDied","Data":"6c91de176890a3885139220bbf03d63ce45afb84b28cb485a704e35fbf68b9f3"} Jul 22 01:48:35.228339 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.228314 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:35.356593 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.356512 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbx9k\" (UniqueName: \"kubernetes.io/projected/6ee9b7ef-60ad-47ed-b947-57c47a918363-kube-api-access-xbx9k\") pod \"6ee9b7ef-60ad-47ed-b947-57c47a918363\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " Jul 22 01:48:35.356593 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.356559 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-bundle\") pod \"6ee9b7ef-60ad-47ed-b947-57c47a918363\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " Jul 22 01:48:35.356593 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.356587 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-util\") pod \"6ee9b7ef-60ad-47ed-b947-57c47a918363\" (UID: \"6ee9b7ef-60ad-47ed-b947-57c47a918363\") " Jul 22 01:48:35.357230 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.357208 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-bundle" (OuterVolumeSpecName: "bundle") pod "6ee9b7ef-60ad-47ed-b947-57c47a918363" (UID: "6ee9b7ef-60ad-47ed-b947-57c47a918363"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:48:35.358663 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.358641 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee9b7ef-60ad-47ed-b947-57c47a918363-kube-api-access-xbx9k" (OuterVolumeSpecName: "kube-api-access-xbx9k") pod "6ee9b7ef-60ad-47ed-b947-57c47a918363" (UID: "6ee9b7ef-60ad-47ed-b947-57c47a918363"). InnerVolumeSpecName "kube-api-access-xbx9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:48:35.360730 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.360703 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-util" (OuterVolumeSpecName: "util") pod "6ee9b7ef-60ad-47ed-b947-57c47a918363" (UID: "6ee9b7ef-60ad-47ed-b947-57c47a918363"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:48:35.457821 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.457789 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbx9k\" (UniqueName: \"kubernetes.io/projected/6ee9b7ef-60ad-47ed-b947-57c47a918363-kube-api-access-xbx9k\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:48:35.457821 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.457821 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-bundle\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:48:35.457821 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:35.457830 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ee9b7ef-60ad-47ed-b947-57c47a918363-util\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:48:36.104302 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:36.104269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" event={"ID":"6ee9b7ef-60ad-47ed-b947-57c47a918363","Type":"ContainerDied","Data":"da825b71030539b13b04f75ebcadc1594b765f5bfa44c7ce08b7e8abab80da09"} Jul 22 01:48:36.104302 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:36.104292 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zfv4p" Jul 22 01:48:36.104508 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:36.104316 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da825b71030539b13b04f75ebcadc1594b765f5bfa44c7ce08b7e8abab80da09" Jul 22 01:48:44.045020 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.044985 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns"] Jul 22 01:48:44.045455 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.045289 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerName="extract" Jul 22 01:48:44.045455 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.045303 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerName="extract" Jul 22 01:48:44.045455 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.045323 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerName="pull" Jul 22 01:48:44.045455 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.045328 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerName="pull" Jul 22 01:48:44.045455 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.045335 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerName="util" Jul 22 01:48:44.045455 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.045340 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerName="util" Jul 22 01:48:44.045455 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.045394 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee9b7ef-60ad-47ed-b947-57c47a918363" containerName="extract" Jul 22 01:48:44.048889 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.048874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.051443 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.051421 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 01:48:44.051605 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.051587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:48:44.051917 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.051897 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g8h79\"" Jul 22 01:48:44.063565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.063545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns"] Jul 22 01:48:44.119675 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.119647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8de7a6f0-e63f-4844-9442-85612251fc6c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvkns\" (UID: \"8de7a6f0-e63f-4844-9442-85612251fc6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.119874 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.119684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqct\" (UniqueName: \"kubernetes.io/projected/8de7a6f0-e63f-4844-9442-85612251fc6c-kube-api-access-fgqct\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvkns\" (UID: \"8de7a6f0-e63f-4844-9442-85612251fc6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.220670 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.220629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8de7a6f0-e63f-4844-9442-85612251fc6c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvkns\" (UID: \"8de7a6f0-e63f-4844-9442-85612251fc6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.220670 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.220668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqct\" (UniqueName: \"kubernetes.io/projected/8de7a6f0-e63f-4844-9442-85612251fc6c-kube-api-access-fgqct\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvkns\" (UID: \"8de7a6f0-e63f-4844-9442-85612251fc6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.221039 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.221021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8de7a6f0-e63f-4844-9442-85612251fc6c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvkns\" (UID: \"8de7a6f0-e63f-4844-9442-85612251fc6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.228261 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.228228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqct\" (UniqueName: \"kubernetes.io/projected/8de7a6f0-e63f-4844-9442-85612251fc6c-kube-api-access-fgqct\") pod \"cert-manager-operator-controller-manager-55c444bf86-gvkns\" (UID: \"8de7a6f0-e63f-4844-9442-85612251fc6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.357806 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.357776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" Jul 22 01:48:44.495483 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:44.495451 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns"] Jul 22 01:48:44.500397 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:48:44.500371 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de7a6f0_e63f_4844_9442_85612251fc6c.slice/crio-fd58e006d6e2f8101bf43d9c109c2cfc3c6e30222e942017aa2aa07f782fe832 WatchSource:0}: Error finding container fd58e006d6e2f8101bf43d9c109c2cfc3c6e30222e942017aa2aa07f782fe832: Status 404 returned error can't find the container with id fd58e006d6e2f8101bf43d9c109c2cfc3c6e30222e942017aa2aa07f782fe832 Jul 22 01:48:45.141528 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:45.141500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" event={"ID":"8de7a6f0-e63f-4844-9442-85612251fc6c","Type":"ContainerStarted","Data":"fd58e006d6e2f8101bf43d9c109c2cfc3c6e30222e942017aa2aa07f782fe832"} Jul 22 01:48:47.151251 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.151212 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" event={"ID":"8de7a6f0-e63f-4844-9442-85612251fc6c","Type":"ContainerStarted","Data":"3183b180bb7559f1b5af9fe026d9c674b638753d8a80854d62d5b2c75b93b99e"} Jul 22 01:48:47.176194 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.176148 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gvkns" podStartSLOduration=1.467912814 podStartE2EDuration="3.176132544s" totalImagesPullingTime="1.70821973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:47.173604663 +0000 UTC m=+246.724818387" watchObservedRunningTime="2026-07-22 01:48:47.176132544 +0000 UTC m=+246.727346261" Jul 22 01:48:47.831098 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.831062 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4"] Jul 22 01:48:47.834509 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.834492 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.836522 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.836501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:48:47.836979 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.836961 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:48:47.837079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.836967 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xlhh\"" Jul 22 01:48:47.842902 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.842884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.842987 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.842928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.842987 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.842963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxnzn\" (UniqueName: \"kubernetes.io/projected/5eed1950-792e-4f90-ba7a-978d12dda7c7-kube-api-access-qxnzn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.849502 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.849482 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4"] Jul 22 01:48:47.944027 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.943995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.944176 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.944045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.944176 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.944072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxnzn\" (UniqueName: \"kubernetes.io/projected/5eed1950-792e-4f90-ba7a-978d12dda7c7-kube-api-access-qxnzn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.944368 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.944351 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.944418 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.944403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:47.959698 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:47.959674 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxnzn\" (UniqueName: \"kubernetes.io/projected/5eed1950-792e-4f90-ba7a-978d12dda7c7-kube-api-access-qxnzn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:48.144117 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:48.144083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:48.282470 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:48:48.282440 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eed1950_792e_4f90_ba7a_978d12dda7c7.slice/crio-e06f278463e37f8546a6ad5dbefe82d966dea47ac2ddfed0bdc5eafa781df231 WatchSource:0}: Error finding container e06f278463e37f8546a6ad5dbefe82d966dea47ac2ddfed0bdc5eafa781df231: Status 404 returned error can't find the container with id e06f278463e37f8546a6ad5dbefe82d966dea47ac2ddfed0bdc5eafa781df231 Jul 22 01:48:48.282816 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:48.282797 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4"] Jul 22 01:48:49.160991 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:49.160957 2579 generic.go:356] "Generic (PLEG): container finished" podID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerID="ca4c2a107a792b7c20fa4bce8afd7b38b7e14c04319f387992d0a817dfe47859" exitCode=0 Jul 22 01:48:49.160991 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:49.160989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" event={"ID":"5eed1950-792e-4f90-ba7a-978d12dda7c7","Type":"ContainerDied","Data":"ca4c2a107a792b7c20fa4bce8afd7b38b7e14c04319f387992d0a817dfe47859"} Jul 22 01:48:49.161335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:49.161044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" event={"ID":"5eed1950-792e-4f90-ba7a-978d12dda7c7","Type":"ContainerStarted","Data":"e06f278463e37f8546a6ad5dbefe82d966dea47ac2ddfed0bdc5eafa781df231"} Jul 22 01:48:51.472026 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.471948 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g55zk"] Jul 22 01:48:51.475006 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.474989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.476955 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.476936 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 01:48:51.477492 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.477476 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 01:48:51.477575 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.477554 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-795fx\"" Jul 22 01:48:51.483480 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.483459 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g55zk"] Jul 22 01:48:51.572773 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.572728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqlx\" (UniqueName: \"kubernetes.io/projected/0419be10-e600-41f2-bd13-8d9901f32f9e-kube-api-access-twqlx\") pod \"cert-manager-cainjector-559cdd8c87-g55zk\" (UID: \"0419be10-e600-41f2-bd13-8d9901f32f9e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.572903 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.572787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0419be10-e600-41f2-bd13-8d9901f32f9e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g55zk\" (UID: \"0419be10-e600-41f2-bd13-8d9901f32f9e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.673675 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.673648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqlx\" (UniqueName: \"kubernetes.io/projected/0419be10-e600-41f2-bd13-8d9901f32f9e-kube-api-access-twqlx\") pod \"cert-manager-cainjector-559cdd8c87-g55zk\" (UID: \"0419be10-e600-41f2-bd13-8d9901f32f9e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.673842 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.673690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0419be10-e600-41f2-bd13-8d9901f32f9e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g55zk\" (UID: \"0419be10-e600-41f2-bd13-8d9901f32f9e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.681399 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.681375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0419be10-e600-41f2-bd13-8d9901f32f9e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g55zk\" (UID: \"0419be10-e600-41f2-bd13-8d9901f32f9e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.681659 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.681636 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqlx\" (UniqueName: \"kubernetes.io/projected/0419be10-e600-41f2-bd13-8d9901f32f9e-kube-api-access-twqlx\") pod \"cert-manager-cainjector-559cdd8c87-g55zk\" (UID: \"0419be10-e600-41f2-bd13-8d9901f32f9e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.795959 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.795886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" Jul 22 01:48:51.921731 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:51.921706 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g55zk"] Jul 22 01:48:51.924208 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:48:51.924187 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0419be10_e600_41f2_bd13_8d9901f32f9e.slice/crio-0d449c46fd73308fcdb55faf28cd058c3cdf81563a9a255986af0173bcee5fb8 WatchSource:0}: Error finding container 0d449c46fd73308fcdb55faf28cd058c3cdf81563a9a255986af0173bcee5fb8: Status 404 returned error can't find the container with id 0d449c46fd73308fcdb55faf28cd058c3cdf81563a9a255986af0173bcee5fb8 Jul 22 01:48:52.177335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:52.177299 2579 generic.go:356] "Generic (PLEG): container finished" podID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerID="3bd28f9e5244b79da6aab27b91ce4af9c242d9b409d7c2b08a0f3d97f276b867" exitCode=0 Jul 22 01:48:52.177483 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:52.177364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" event={"ID":"5eed1950-792e-4f90-ba7a-978d12dda7c7","Type":"ContainerDied","Data":"3bd28f9e5244b79da6aab27b91ce4af9c242d9b409d7c2b08a0f3d97f276b867"} Jul 22 01:48:52.178957 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:52.178940 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" event={"ID":"0419be10-e600-41f2-bd13-8d9901f32f9e","Type":"ContainerStarted","Data":"0d449c46fd73308fcdb55faf28cd058c3cdf81563a9a255986af0173bcee5fb8"} Jul 22 01:48:53.187053 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:53.187019 2579 generic.go:356] "Generic (PLEG): container finished" podID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerID="b141b92f655ce6ef0b0f6290fdf86ebc4d76453e5032e68b4898e63e52a98885" exitCode=0 Jul 22 01:48:53.187499 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:53.187062 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" event={"ID":"5eed1950-792e-4f90-ba7a-978d12dda7c7","Type":"ContainerDied","Data":"b141b92f655ce6ef0b0f6290fdf86ebc4d76453e5032e68b4898e63e52a98885"} Jul 22 01:48:54.675341 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.675315 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:54.695922 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.695896 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-util\") pod \"5eed1950-792e-4f90-ba7a-978d12dda7c7\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " Jul 22 01:48:54.696038 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.695933 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxnzn\" (UniqueName: \"kubernetes.io/projected/5eed1950-792e-4f90-ba7a-978d12dda7c7-kube-api-access-qxnzn\") pod \"5eed1950-792e-4f90-ba7a-978d12dda7c7\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " Jul 22 01:48:54.696038 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.696022 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-bundle\") pod \"5eed1950-792e-4f90-ba7a-978d12dda7c7\" (UID: \"5eed1950-792e-4f90-ba7a-978d12dda7c7\") " Jul 22 01:48:54.696445 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.696389 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-bundle" (OuterVolumeSpecName: "bundle") pod "5eed1950-792e-4f90-ba7a-978d12dda7c7" (UID: "5eed1950-792e-4f90-ba7a-978d12dda7c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:48:54.698130 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.698106 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eed1950-792e-4f90-ba7a-978d12dda7c7-kube-api-access-qxnzn" (OuterVolumeSpecName: "kube-api-access-qxnzn") pod "5eed1950-792e-4f90-ba7a-978d12dda7c7" (UID: "5eed1950-792e-4f90-ba7a-978d12dda7c7"). InnerVolumeSpecName "kube-api-access-qxnzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:48:54.702018 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.701978 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-util" (OuterVolumeSpecName: "util") pod "5eed1950-792e-4f90-ba7a-978d12dda7c7" (UID: "5eed1950-792e-4f90-ba7a-978d12dda7c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:48:54.797070 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.797044 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-bundle\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:48:54.797070 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.797070 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eed1950-792e-4f90-ba7a-978d12dda7c7-util\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:48:54.797228 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:54.797080 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxnzn\" (UniqueName: \"kubernetes.io/projected/5eed1950-792e-4f90-ba7a-978d12dda7c7-kube-api-access-qxnzn\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:48:55.207574 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:55.207541 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" Jul 22 01:48:55.207574 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:55.207548 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fps6x4" event={"ID":"5eed1950-792e-4f90-ba7a-978d12dda7c7","Type":"ContainerDied","Data":"e06f278463e37f8546a6ad5dbefe82d966dea47ac2ddfed0bdc5eafa781df231"} Jul 22 01:48:55.207819 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:55.207597 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e06f278463e37f8546a6ad5dbefe82d966dea47ac2ddfed0bdc5eafa781df231" Jul 22 01:48:55.209133 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:55.209107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" event={"ID":"0419be10-e600-41f2-bd13-8d9901f32f9e","Type":"ContainerStarted","Data":"d8f6264976804c2876f50d5f3372162a9dad56a202dfaef1362eca88c4838a38"} Jul 22 01:48:55.224311 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:48:55.224264 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g55zk" podStartSLOduration=1.423852162 podStartE2EDuration="4.224252394s" totalImagesPullingTime="2.800400232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:55.222810034 +0000 UTC m=+254.774023747" watchObservedRunningTime="2026-07-22 01:48:55.224252394 +0000 UTC m=+254.775466106" Jul 22 01:49:02.204800 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.204768 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt"] Jul 22 01:49:02.205138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.205038 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerName="pull" Jul 22 01:49:02.205138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.205049 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerName="pull" Jul 22 01:49:02.205138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.205059 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerName="util" Jul 22 01:49:02.205138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.205064 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerName="util" Jul 22 01:49:02.205138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.205082 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerName="extract" Jul 22 01:49:02.205138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.205087 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerName="extract" Jul 22 01:49:02.205138 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.205134 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eed1950-792e-4f90-ba7a-978d12dda7c7" containerName="extract" Jul 22 01:49:02.208146 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.208130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.210225 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.210203 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 01:49:02.210335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.210264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:49:02.210660 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.210646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sl75g\"" Jul 22 01:49:02.218127 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.218107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt"] Jul 22 01:49:02.255557 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.255526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec0d113-016f-4661-abad-3e85850d41fd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-26kkt\" (UID: \"6ec0d113-016f-4661-abad-3e85850d41fd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.255669 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.255616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4zj\" (UniqueName: \"kubernetes.io/projected/6ec0d113-016f-4661-abad-3e85850d41fd-kube-api-access-2w4zj\") pod \"openshift-lws-operator-fd8ccff4c-26kkt\" (UID: \"6ec0d113-016f-4661-abad-3e85850d41fd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.355934 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.355907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4zj\" (UniqueName: \"kubernetes.io/projected/6ec0d113-016f-4661-abad-3e85850d41fd-kube-api-access-2w4zj\") pod \"openshift-lws-operator-fd8ccff4c-26kkt\" (UID: \"6ec0d113-016f-4661-abad-3e85850d41fd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.356047 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.355944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec0d113-016f-4661-abad-3e85850d41fd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-26kkt\" (UID: \"6ec0d113-016f-4661-abad-3e85850d41fd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.356340 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.356322 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec0d113-016f-4661-abad-3e85850d41fd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-26kkt\" (UID: \"6ec0d113-016f-4661-abad-3e85850d41fd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.363577 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.363558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4zj\" (UniqueName: \"kubernetes.io/projected/6ec0d113-016f-4661-abad-3e85850d41fd-kube-api-access-2w4zj\") pod \"openshift-lws-operator-fd8ccff4c-26kkt\" (UID: \"6ec0d113-016f-4661-abad-3e85850d41fd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.517562 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.517505 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" Jul 22 01:49:02.640765 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:02.640720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt"] Jul 22 01:49:02.643367 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:49:02.643341 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ec0d113_016f_4661_abad_3e85850d41fd.slice/crio-79c505e75e5757efe8d3494ee4f416c6ae0ea869c69f85b80f4d4351443568e7 WatchSource:0}: Error finding container 79c505e75e5757efe8d3494ee4f416c6ae0ea869c69f85b80f4d4351443568e7: Status 404 returned error can't find the container with id 79c505e75e5757efe8d3494ee4f416c6ae0ea869c69f85b80f4d4351443568e7 Jul 22 01:49:03.244803 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:03.244771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" event={"ID":"6ec0d113-016f-4661-abad-3e85850d41fd","Type":"ContainerStarted","Data":"79c505e75e5757efe8d3494ee4f416c6ae0ea869c69f85b80f4d4351443568e7"} Jul 22 01:49:05.255819 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:05.255782 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" event={"ID":"6ec0d113-016f-4661-abad-3e85850d41fd","Type":"ContainerStarted","Data":"645c063b0bef9aeefebab621433b2418fd14495c27d1ed8e2b7855ef8827dc25"} Jul 22 01:49:05.268935 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:05.268885 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-26kkt" podStartSLOduration=1.330486479 podStartE2EDuration="3.268867966s" totalImagesPullingTime="1.938381487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:05.268429744 +0000 UTC m=+264.819643458" watchObservedRunningTime="2026-07-22 01:49:05.268867966 +0000 UTC m=+264.820081681" Jul 22 01:49:07.844759 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.844715 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn"] Jul 22 01:49:07.867129 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.867097 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn"] Jul 22 01:49:07.867263 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.867198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.869369 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.869344 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:49:07.869496 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.869357 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xlhh\"" Jul 22 01:49:07.869956 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.869939 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:49:07.896635 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.896607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4twm\" (UniqueName: \"kubernetes.io/projected/f8427faf-e22e-479d-bc80-9a94b6952bf0-kube-api-access-r4twm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.896781 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.896660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.896781 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.896724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.997094 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.997062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.997235 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.997128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.997235 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.997150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4twm\" (UniqueName: \"kubernetes.io/projected/f8427faf-e22e-479d-bc80-9a94b6952bf0-kube-api-access-r4twm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.997554 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.997525 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:07.997554 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:07.997539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:08.004700 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:08.004675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4twm\" (UniqueName: \"kubernetes.io/projected/f8427faf-e22e-479d-bc80-9a94b6952bf0-kube-api-access-r4twm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:08.176312 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:08.176235 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:08.318900 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:08.318865 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn"] Jul 22 01:49:08.320903 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:49:08.320873 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8427faf_e22e_479d_bc80_9a94b6952bf0.slice/crio-c516d3999fe3bfdbc49caa5c018b7ae52aedc6ec128abf33d8fda24e389c0907 WatchSource:0}: Error finding container c516d3999fe3bfdbc49caa5c018b7ae52aedc6ec128abf33d8fda24e389c0907: Status 404 returned error can't find the container with id c516d3999fe3bfdbc49caa5c018b7ae52aedc6ec128abf33d8fda24e389c0907 Jul 22 01:49:09.279891 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:09.279803 2579 generic.go:356] "Generic (PLEG): container finished" podID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerID="189bfbf64e5de593f1b655a1e31ec801bb8c31e57cb1faaefc6e5d2fcae7536e" exitCode=0 Jul 22 01:49:09.280325 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:09.279892 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" event={"ID":"f8427faf-e22e-479d-bc80-9a94b6952bf0","Type":"ContainerDied","Data":"189bfbf64e5de593f1b655a1e31ec801bb8c31e57cb1faaefc6e5d2fcae7536e"} Jul 22 01:49:09.280325 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:09.279932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" event={"ID":"f8427faf-e22e-479d-bc80-9a94b6952bf0","Type":"ContainerStarted","Data":"c516d3999fe3bfdbc49caa5c018b7ae52aedc6ec128abf33d8fda24e389c0907"} Jul 22 01:49:10.286115 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:10.286022 2579 generic.go:356] "Generic (PLEG): container finished" podID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerID="a32d6aeda4b762caa18b30640afb27fd2fcfe074ece7e6678b22ad2e5b11bdac" exitCode=0 Jul 22 01:49:10.286509 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:10.286113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" event={"ID":"f8427faf-e22e-479d-bc80-9a94b6952bf0","Type":"ContainerDied","Data":"a32d6aeda4b762caa18b30640afb27fd2fcfe074ece7e6678b22ad2e5b11bdac"} Jul 22 01:49:11.291882 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:11.291842 2579 generic.go:356] "Generic (PLEG): container finished" podID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerID="4b897fa3b5184e9a19de947022aea286a9663b5c9285e9891b2ab244aa0eda54" exitCode=0 Jul 22 01:49:11.292269 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:11.291934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" event={"ID":"f8427faf-e22e-479d-bc80-9a94b6952bf0","Type":"ContainerDied","Data":"4b897fa3b5184e9a19de947022aea286a9663b5c9285e9891b2ab244aa0eda54"} Jul 22 01:49:12.421121 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.421099 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:12.531858 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.531828 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-bundle\") pod \"f8427faf-e22e-479d-bc80-9a94b6952bf0\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " Jul 22 01:49:12.531858 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.531861 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-util\") pod \"f8427faf-e22e-479d-bc80-9a94b6952bf0\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " Jul 22 01:49:12.532089 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.531930 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4twm\" (UniqueName: \"kubernetes.io/projected/f8427faf-e22e-479d-bc80-9a94b6952bf0-kube-api-access-r4twm\") pod \"f8427faf-e22e-479d-bc80-9a94b6952bf0\" (UID: \"f8427faf-e22e-479d-bc80-9a94b6952bf0\") " Jul 22 01:49:12.532594 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.532568 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-bundle" (OuterVolumeSpecName: "bundle") pod "f8427faf-e22e-479d-bc80-9a94b6952bf0" (UID: "f8427faf-e22e-479d-bc80-9a94b6952bf0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:49:12.534017 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.533991 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8427faf-e22e-479d-bc80-9a94b6952bf0-kube-api-access-r4twm" (OuterVolumeSpecName: "kube-api-access-r4twm") pod "f8427faf-e22e-479d-bc80-9a94b6952bf0" (UID: "f8427faf-e22e-479d-bc80-9a94b6952bf0"). InnerVolumeSpecName "kube-api-access-r4twm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:49:12.537666 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.537638 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-util" (OuterVolumeSpecName: "util") pod "f8427faf-e22e-479d-bc80-9a94b6952bf0" (UID: "f8427faf-e22e-479d-bc80-9a94b6952bf0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:49:12.633117 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.633087 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4twm\" (UniqueName: \"kubernetes.io/projected/f8427faf-e22e-479d-bc80-9a94b6952bf0-kube-api-access-r4twm\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:49:12.633117 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.633112 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-bundle\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:49:12.633117 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:12.633120 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8427faf-e22e-479d-bc80-9a94b6952bf0-util\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:49:13.302000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:13.301916 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" Jul 22 01:49:13.302000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:13.301936 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdb2xn" event={"ID":"f8427faf-e22e-479d-bc80-9a94b6952bf0","Type":"ContainerDied","Data":"c516d3999fe3bfdbc49caa5c018b7ae52aedc6ec128abf33d8fda24e389c0907"} Jul 22 01:49:13.302000 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:13.301982 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c516d3999fe3bfdbc49caa5c018b7ae52aedc6ec128abf33d8fda24e389c0907" Jul 22 01:49:25.142037 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142002 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2"] Jul 22 01:49:25.142402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142307 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerName="extract" Jul 22 01:49:25.142402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142318 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerName="extract" Jul 22 01:49:25.142402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142329 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerName="util" Jul 22 01:49:25.142402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142334 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerName="util" Jul 22 01:49:25.142402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142341 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerName="pull" Jul 22 01:49:25.142402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142346 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerName="pull" Jul 22 01:49:25.142402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.142398 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8427faf-e22e-479d-bc80-9a94b6952bf0" containerName="extract" Jul 22 01:49:25.148132 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.148107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.152521 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.152492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ghhvt\"" Jul 22 01:49:25.152655 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.152494 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 01:49:25.152896 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.152881 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 01:49:25.153147 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.153133 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 01:49:25.153293 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.153272 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 01:49:25.175734 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.175711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2"] Jul 22 01:49:25.229001 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.228968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8193bf6-d109-41d5-a13d-42bb1583756a-manifests\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.229158 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.229026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9mck\" (UniqueName: \"kubernetes.io/projected/d8193bf6-d109-41d5-a13d-42bb1583756a-kube-api-access-x9mck\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.229158 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.229063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8193bf6-d109-41d5-a13d-42bb1583756a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.229158 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.229088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8193bf6-d109-41d5-a13d-42bb1583756a-tmp\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.229281 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.229199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8193bf6-d109-41d5-a13d-42bb1583756a-webhook-cert\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.329825 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.329795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8193bf6-d109-41d5-a13d-42bb1583756a-manifests\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.330005 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.329858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mck\" (UniqueName: \"kubernetes.io/projected/d8193bf6-d109-41d5-a13d-42bb1583756a-kube-api-access-x9mck\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.330005 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.329893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8193bf6-d109-41d5-a13d-42bb1583756a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.330005 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.329918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8193bf6-d109-41d5-a13d-42bb1583756a-tmp\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.330005 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.329990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8193bf6-d109-41d5-a13d-42bb1583756a-webhook-cert\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.330233 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.330170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8193bf6-d109-41d5-a13d-42bb1583756a-manifests\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.332183 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.332161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8193bf6-d109-41d5-a13d-42bb1583756a-tmp\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.332328 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.332312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8193bf6-d109-41d5-a13d-42bb1583756a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.332503 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.332484 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8193bf6-d109-41d5-a13d-42bb1583756a-webhook-cert\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.337804 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.337782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9mck\" (UniqueName: \"kubernetes.io/projected/d8193bf6-d109-41d5-a13d-42bb1583756a-kube-api-access-x9mck\") pod \"opendatahub-operator-controller-manager-585784b644-n2jf2\" (UID: \"d8193bf6-d109-41d5-a13d-42bb1583756a\") " pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.458547 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.458469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:25.602548 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:25.602527 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2"] Jul 22 01:49:25.605756 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:49:25.605714 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8193bf6_d109_41d5_a13d_42bb1583756a.slice/crio-1ebcf1245311bc5c5a18da855879ffe84a737d7f483a0dd01b0cc341d1d2ad14 WatchSource:0}: Error finding container 1ebcf1245311bc5c5a18da855879ffe84a737d7f483a0dd01b0cc341d1d2ad14: Status 404 returned error can't find the container with id 1ebcf1245311bc5c5a18da855879ffe84a737d7f483a0dd01b0cc341d1d2ad14 Jul 22 01:49:26.361851 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:26.361798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" event={"ID":"d8193bf6-d109-41d5-a13d-42bb1583756a","Type":"ContainerStarted","Data":"1ebcf1245311bc5c5a18da855879ffe84a737d7f483a0dd01b0cc341d1d2ad14"} Jul 22 01:49:29.378291 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:29.378262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" event={"ID":"d8193bf6-d109-41d5-a13d-42bb1583756a","Type":"ContainerStarted","Data":"4dfc33c531628d663683da5c26711e1f452a5aadbf2bd8f14a0165fa6fec582c"} Jul 22 01:49:30.384250 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:30.384210 2579 generic.go:356] "Generic (PLEG): container finished" podID="d8193bf6-d109-41d5-a13d-42bb1583756a" containerID="4dfc33c531628d663683da5c26711e1f452a5aadbf2bd8f14a0165fa6fec582c" exitCode=0 Jul 22 01:49:30.384610 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:30.384256 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" event={"ID":"d8193bf6-d109-41d5-a13d-42bb1583756a","Type":"ContainerDied","Data":"4dfc33c531628d663683da5c26711e1f452a5aadbf2bd8f14a0165fa6fec582c"} Jul 22 01:49:31.390078 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:31.390039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" event={"ID":"d8193bf6-d109-41d5-a13d-42bb1583756a","Type":"ContainerStarted","Data":"72f1a43e5b54de347c0de64128738b90c187b8ce568b22f43dc6b77965daad06"} Jul 22 01:49:31.390485 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:31.390201 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:31.413501 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:31.413455 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" podStartSLOduration=2.146941531 podStartE2EDuration="6.413441429s" totalImagesPullingTime="3.236099067s" totalInitContainerRuntime="1.030400831s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:31.411350651 +0000 UTC m=+290.962564354" watchObservedRunningTime="2026-07-22 01:49:31.413441429 +0000 UTC m=+290.964655142" Jul 22 01:49:40.887625 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:40.887599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:49:40.888163 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:40.887880 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:49:40.892426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:40.892406 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:49:40.892426 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:40.892418 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:49:40.898191 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:40.898173 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 01:49:42.396842 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:42.396813 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-585784b644-n2jf2" Jul 22 01:49:44.802013 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.801976 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55d847747c-4wbml"] Jul 22 01:49:44.805469 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.805450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.811177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.811142 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 01:49:44.811177 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.811160 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 01:49:44.812674 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.812651 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5mjjm\"" Jul 22 01:49:44.827394 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.827363 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55d847747c-4wbml"] Jul 22 01:49:44.884500 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.884468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-tmp\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.884674 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.884511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-tls-certs\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.884674 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.884588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdgbl\" (UniqueName: \"kubernetes.io/projected/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-kube-api-access-xdgbl\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.973845 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.973816 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rcdpr"] Jul 22 01:49:44.977261 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.977237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:44.980431 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.980408 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nkpb8\"" Jul 22 01:49:44.982375 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.982338 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 22 01:49:44.985535 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.985501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-tmp\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.985535 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.985537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-tls-certs\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.985708 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.985562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdgbl\" (UniqueName: \"kubernetes.io/projected/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-kube-api-access-xdgbl\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.987922 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.987898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-tmp\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:44.988022 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:44.987898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-tls-certs\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:45.001910 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.001883 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rcdpr"] Jul 22 01:49:45.004601 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.004574 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdgbl\" (UniqueName: \"kubernetes.io/projected/11072660-23ef-4c15-91ed-0ad8c0ad6f1e-kube-api-access-xdgbl\") pod \"kube-auth-proxy-55d847747c-4wbml\" (UID: \"11072660-23ef-4c15-91ed-0ad8c0ad6f1e\") " pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:45.086638 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.086546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc6c02d4-4189-45ed-b8eb-ced8625af5be-cert\") pod \"odh-model-controller-7998c67dc4-rcdpr\" (UID: \"fc6c02d4-4189-45ed-b8eb-ced8625af5be\") " pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:45.086638 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.086605 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9g9l\" (UniqueName: \"kubernetes.io/projected/fc6c02d4-4189-45ed-b8eb-ced8625af5be-kube-api-access-h9g9l\") pod \"odh-model-controller-7998c67dc4-rcdpr\" (UID: \"fc6c02d4-4189-45ed-b8eb-ced8625af5be\") " pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:45.116487 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.116454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" Jul 22 01:49:45.188040 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.188011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc6c02d4-4189-45ed-b8eb-ced8625af5be-cert\") pod \"odh-model-controller-7998c67dc4-rcdpr\" (UID: \"fc6c02d4-4189-45ed-b8eb-ced8625af5be\") " pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:45.188211 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.188051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9g9l\" (UniqueName: \"kubernetes.io/projected/fc6c02d4-4189-45ed-b8eb-ced8625af5be-kube-api-access-h9g9l\") pod \"odh-model-controller-7998c67dc4-rcdpr\" (UID: \"fc6c02d4-4189-45ed-b8eb-ced8625af5be\") " pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:45.190478 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.190451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc6c02d4-4189-45ed-b8eb-ced8625af5be-cert\") pod \"odh-model-controller-7998c67dc4-rcdpr\" (UID: \"fc6c02d4-4189-45ed-b8eb-ced8625af5be\") " pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:45.197815 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.197789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9g9l\" (UniqueName: \"kubernetes.io/projected/fc6c02d4-4189-45ed-b8eb-ced8625af5be-kube-api-access-h9g9l\") pod \"odh-model-controller-7998c67dc4-rcdpr\" (UID: \"fc6c02d4-4189-45ed-b8eb-ced8625af5be\") " pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:45.274014 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.273984 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55d847747c-4wbml"] Jul 22 01:49:45.276960 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:49:45.276934 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11072660_23ef_4c15_91ed_0ad8c0ad6f1e.slice/crio-26662e9752f143ab5cda52587b26a3f11fd6553d51431a4b1d03f46383730876 WatchSource:0}: Error finding container 26662e9752f143ab5cda52587b26a3f11fd6553d51431a4b1d03f46383730876: Status 404 returned error can't find the container with id 26662e9752f143ab5cda52587b26a3f11fd6553d51431a4b1d03f46383730876 Jul 22 01:49:45.278701 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.278688 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:49:45.287461 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.287437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:45.433504 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.433479 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rcdpr"] Jul 22 01:49:45.436285 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:49:45.436262 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6c02d4_4189_45ed_b8eb_ced8625af5be.slice/crio-3af350a2e5d900bcb6c2f2a6c589b544279ee0c84ffa597af1fa806f6d8702d0 WatchSource:0}: Error finding container 3af350a2e5d900bcb6c2f2a6c589b544279ee0c84ffa597af1fa806f6d8702d0: Status 404 returned error can't find the container with id 3af350a2e5d900bcb6c2f2a6c589b544279ee0c84ffa597af1fa806f6d8702d0 Jul 22 01:49:45.453668 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.453640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" event={"ID":"fc6c02d4-4189-45ed-b8eb-ced8625af5be","Type":"ContainerStarted","Data":"3af350a2e5d900bcb6c2f2a6c589b544279ee0c84ffa597af1fa806f6d8702d0"} Jul 22 01:49:45.454661 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:45.454640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" event={"ID":"11072660-23ef-4c15-91ed-0ad8c0ad6f1e","Type":"ContainerStarted","Data":"26662e9752f143ab5cda52587b26a3f11fd6553d51431a4b1d03f46383730876"} Jul 22 01:49:49.481477 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:49.481436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" event={"ID":"fc6c02d4-4189-45ed-b8eb-ced8625af5be","Type":"ContainerStarted","Data":"1c88ac071adaffb3b6e3fc02e3813b48b52160072aa9a42c44b2388e4c52e5ac"} Jul 22 01:49:49.481883 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:49.481529 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:49:49.482942 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:49.482917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" event={"ID":"11072660-23ef-4c15-91ed-0ad8c0ad6f1e","Type":"ContainerStarted","Data":"3c52102d055a734363963560e5136d8c08beb80979bd18f8e1e65b6086e8c6a7"} Jul 22 01:49:49.498232 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:49.498190 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" podStartSLOduration=2.190121885 podStartE2EDuration="5.498178054s" totalImagesPullingTime="3.308056169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:49.496297353 +0000 UTC m=+309.047511066" watchObservedRunningTime="2026-07-22 01:49:49.498178054 +0000 UTC m=+309.049391837" Jul 22 01:49:49.513347 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:49.513310 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55d847747c-4wbml" podStartSLOduration=2.05108089 podStartE2EDuration="5.513298662s" totalImagesPullingTime="3.462217772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:49.511305112 +0000 UTC m=+309.062518827" watchObservedRunningTime="2026-07-22 01:49:49.513298662 +0000 UTC m=+309.064512393" Jul 22 01:49:50.448147 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.448113 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t"] Jul 22 01:49:50.451496 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.451480 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.453666 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.453642 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 01:49:50.454166 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.454142 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 01:49:50.454299 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.454282 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 01:49:50.454392 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.454379 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5xqpc\"" Jul 22 01:49:50.459505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.459484 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t"] Jul 22 01:49:50.534933 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.534910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/223f5708-cf42-4d59-bac0-3616b1eb82cb-cert\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.535243 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.534951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9th6f\" (UniqueName: \"kubernetes.io/projected/223f5708-cf42-4d59-bac0-3616b1eb82cb-kube-api-access-9th6f\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.535243 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.534976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/223f5708-cf42-4d59-bac0-3616b1eb82cb-metrics-cert\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.535243 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.535050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/223f5708-cf42-4d59-bac0-3616b1eb82cb-manager-config\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.636295 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.636267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9th6f\" (UniqueName: \"kubernetes.io/projected/223f5708-cf42-4d59-bac0-3616b1eb82cb-kube-api-access-9th6f\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.636295 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.636297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/223f5708-cf42-4d59-bac0-3616b1eb82cb-metrics-cert\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.636553 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.636524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/223f5708-cf42-4d59-bac0-3616b1eb82cb-manager-config\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.636709 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.636632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/223f5708-cf42-4d59-bac0-3616b1eb82cb-cert\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.637255 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.637229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/223f5708-cf42-4d59-bac0-3616b1eb82cb-manager-config\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.638994 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.638976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/223f5708-cf42-4d59-bac0-3616b1eb82cb-metrics-cert\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.639079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.639016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/223f5708-cf42-4d59-bac0-3616b1eb82cb-cert\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.644129 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.644110 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9th6f\" (UniqueName: \"kubernetes.io/projected/223f5708-cf42-4d59-bac0-3616b1eb82cb-kube-api-access-9th6f\") pod \"lws-controller-manager-7fb968c57-5dm7t\" (UID: \"223f5708-cf42-4d59-bac0-3616b1eb82cb\") " pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.761351 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.761296 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:50.885711 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:50.885680 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t"] Jul 22 01:49:50.889713 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:49:50.889677 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223f5708_cf42_4d59_bac0_3616b1eb82cb.slice/crio-fb772e9e241b6419b24a6463f1e921746310723324512f18de25074cdd901d08 WatchSource:0}: Error finding container fb772e9e241b6419b24a6463f1e921746310723324512f18de25074cdd901d08: Status 404 returned error can't find the container with id fb772e9e241b6419b24a6463f1e921746310723324512f18de25074cdd901d08 Jul 22 01:49:51.494139 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:51.494092 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" event={"ID":"223f5708-cf42-4d59-bac0-3616b1eb82cb","Type":"ContainerStarted","Data":"fb772e9e241b6419b24a6463f1e921746310723324512f18de25074cdd901d08"} Jul 22 01:49:53.506388 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:53.506349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" event={"ID":"223f5708-cf42-4d59-bac0-3616b1eb82cb","Type":"ContainerStarted","Data":"0ba140a243f70704eea48f8742707436736b0aefb9374a4057c0e431862fb09e"} Jul 22 01:49:53.506821 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:53.506494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:49:53.538529 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:49:53.538468 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" podStartSLOduration=1.547525733 podStartE2EDuration="3.538448868s" totalImagesPullingTime="1.990923135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:53.53690145 +0000 UTC m=+313.088115163" watchObservedRunningTime="2026-07-22 01:49:53.538448868 +0000 UTC m=+313.089662582" Jul 22 01:50:00.490328 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:50:00.490294 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rcdpr" Jul 22 01:50:04.513084 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:50:04.513052 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb968c57-5dm7t" Jul 22 01:51:02.331948 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.331911 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w"] Jul 22 01:51:02.335473 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.335458 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.337613 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.337587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 01:51:02.337766 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.337644 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-clbcz\"" Jul 22 01:51:02.338235 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.338217 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 01:51:02.342996 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.342630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w"] Jul 22 01:51:02.419145 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.419113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.419315 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.419160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wsh6\" (UniqueName: \"kubernetes.io/projected/fc975532-22e2-492e-9c13-176575e4decd-kube-api-access-7wsh6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.419315 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.419186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.519676 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.519635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.519893 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.519713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wsh6\" (UniqueName: \"kubernetes.io/projected/fc975532-22e2-492e-9c13-176575e4decd-kube-api-access-7wsh6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.519893 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.519769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.520155 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.520136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.520243 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.520153 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.527673 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.527647 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wsh6\" (UniqueName: \"kubernetes.io/projected/fc975532-22e2-492e-9c13-176575e4decd-kube-api-access-7wsh6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.529349 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.529326 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc"] Jul 22 01:51:02.532727 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.532708 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.539841 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.539823 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc"] Jul 22 01:51:02.620615 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.620585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.620816 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.620670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.620816 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.620787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ps2\" (UniqueName: \"kubernetes.io/projected/dd75a623-9db2-4cc1-9605-ec992241481e-kube-api-access-98ps2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.645450 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.645422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:02.721820 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.721726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.721997 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.721828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.721997 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.721873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ps2\" (UniqueName: \"kubernetes.io/projected/dd75a623-9db2-4cc1-9605-ec992241481e-kube-api-access-98ps2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.722221 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.722200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.722270 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.722231 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.732155 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.732128 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x"] Jul 22 01:51:02.733875 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.733841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ps2\" (UniqueName: \"kubernetes.io/projected/dd75a623-9db2-4cc1-9605-ec992241481e-kube-api-access-98ps2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.736980 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.736960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.746554 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.746523 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x"] Jul 22 01:51:02.790887 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.790857 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w"] Jul 22 01:51:02.794855 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:51:02.794828 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc975532_22e2_492e_9c13_176575e4decd.slice/crio-c844b1cf1eb21b472d64e3f693205da544a1c8fc943f17a09cf66f5ab9de8176 WatchSource:0}: Error finding container c844b1cf1eb21b472d64e3f693205da544a1c8fc943f17a09cf66f5ab9de8176: Status 404 returned error can't find the container with id c844b1cf1eb21b472d64e3f693205da544a1c8fc943f17a09cf66f5ab9de8176 Jul 22 01:51:02.822588 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.822561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.822703 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.822604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.822703 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.822657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7dk\" (UniqueName: \"kubernetes.io/projected/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-kube-api-access-hh7dk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.835881 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.835854 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" event={"ID":"fc975532-22e2-492e-9c13-176575e4decd","Type":"ContainerStarted","Data":"c844b1cf1eb21b472d64e3f693205da544a1c8fc943f17a09cf66f5ab9de8176"} Jul 22 01:51:02.844713 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.844689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:02.923751 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.923711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.923880 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.923775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.923880 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.923822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7dk\" (UniqueName: \"kubernetes.io/projected/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-kube-api-access-hh7dk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.924156 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.924137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.924191 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.924149 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.932415 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.932386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7dk\" (UniqueName: \"kubernetes.io/projected/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-kube-api-access-hh7dk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:02.983069 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:02.983038 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc"] Jul 22 01:51:02.986223 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:51:02.986198 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd75a623_9db2_4cc1_9605_ec992241481e.slice/crio-a4466b865b9af8460313c5287276e95bd58fd09f89b527a1160e5b3eccf77ec6 WatchSource:0}: Error finding container a4466b865b9af8460313c5287276e95bd58fd09f89b527a1160e5b3eccf77ec6: Status 404 returned error can't find the container with id a4466b865b9af8460313c5287276e95bd58fd09f89b527a1160e5b3eccf77ec6 Jul 22 01:51:03.052521 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.052490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:03.187291 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.187264 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x"] Jul 22 01:51:03.189522 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:51:03.189491 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb73ba1_713d_4ba0_9a33_3315197dcbfa.slice/crio-730e866f27c67ce42fa805f35e88b46b31d21ad28cf1e93b4aa483d77abe3341 WatchSource:0}: Error finding container 730e866f27c67ce42fa805f35e88b46b31d21ad28cf1e93b4aa483d77abe3341: Status 404 returned error can't find the container with id 730e866f27c67ce42fa805f35e88b46b31d21ad28cf1e93b4aa483d77abe3341 Jul 22 01:51:03.332988 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.332958 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq"] Jul 22 01:51:03.336424 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.336405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.344012 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.343988 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq"] Jul 22 01:51:03.427559 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.427523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzw7\" (UniqueName: \"kubernetes.io/projected/c49fe75a-e876-46a2-9be2-35b2d1f73a26-kube-api-access-kgzw7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.427724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.427566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.427724 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.427642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.528126 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.528032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.528126 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.528084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzw7\" (UniqueName: \"kubernetes.io/projected/c49fe75a-e876-46a2-9be2-35b2d1f73a26-kube-api-access-kgzw7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.528126 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.528112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.528484 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.528467 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.528543 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.528465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.536542 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.536510 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzw7\" (UniqueName: \"kubernetes.io/projected/c49fe75a-e876-46a2-9be2-35b2d1f73a26-kube-api-access-kgzw7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.667348 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.667304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:03.797787 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.797715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq"] Jul 22 01:51:03.800470 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:51:03.800445 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49fe75a_e876_46a2_9be2_35b2d1f73a26.slice/crio-eb653fd2c8f68074e5b36f9d0f9042908b10859a764dbc2a6948ecbedea28f8f WatchSource:0}: Error finding container eb653fd2c8f68074e5b36f9d0f9042908b10859a764dbc2a6948ecbedea28f8f: Status 404 returned error can't find the container with id eb653fd2c8f68074e5b36f9d0f9042908b10859a764dbc2a6948ecbedea28f8f Jul 22 01:51:03.843124 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.843093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" event={"ID":"c49fe75a-e876-46a2-9be2-35b2d1f73a26","Type":"ContainerStarted","Data":"eb653fd2c8f68074e5b36f9d0f9042908b10859a764dbc2a6948ecbedea28f8f"} Jul 22 01:51:03.844582 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.844557 2579 generic.go:356] "Generic (PLEG): container finished" podID="dd75a623-9db2-4cc1-9605-ec992241481e" containerID="8e0eb4e187a4cf8e31a9b125ba757659d3015310cc01835487cdf746573b96ec" exitCode=0 Jul 22 01:51:03.844675 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.844640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" event={"ID":"dd75a623-9db2-4cc1-9605-ec992241481e","Type":"ContainerDied","Data":"8e0eb4e187a4cf8e31a9b125ba757659d3015310cc01835487cdf746573b96ec"} Jul 22 01:51:03.844736 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.844683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" event={"ID":"dd75a623-9db2-4cc1-9605-ec992241481e","Type":"ContainerStarted","Data":"a4466b865b9af8460313c5287276e95bd58fd09f89b527a1160e5b3eccf77ec6"} Jul 22 01:51:03.846133 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.846112 2579 generic.go:356] "Generic (PLEG): container finished" podID="fc975532-22e2-492e-9c13-176575e4decd" containerID="e7666aa44777f5b026762d7e235f8af9fa6ea2879886add1d8ac329a585f74be" exitCode=0 Jul 22 01:51:03.846227 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.846139 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" event={"ID":"fc975532-22e2-492e-9c13-176575e4decd","Type":"ContainerDied","Data":"e7666aa44777f5b026762d7e235f8af9fa6ea2879886add1d8ac329a585f74be"} Jul 22 01:51:03.848228 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.848205 2579 generic.go:356] "Generic (PLEG): container finished" podID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerID="7bf1b51e8343e86e31b40c18fa904485702cff35e25d90eb6ce18f7fbda1ee5b" exitCode=0 Jul 22 01:51:03.848325 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.848255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" event={"ID":"6fb73ba1-713d-4ba0-9a33-3315197dcbfa","Type":"ContainerDied","Data":"7bf1b51e8343e86e31b40c18fa904485702cff35e25d90eb6ce18f7fbda1ee5b"} Jul 22 01:51:03.848325 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:03.848288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" event={"ID":"6fb73ba1-713d-4ba0-9a33-3315197dcbfa","Type":"ContainerStarted","Data":"730e866f27c67ce42fa805f35e88b46b31d21ad28cf1e93b4aa483d77abe3341"} Jul 22 01:51:04.855050 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:04.855019 2579 generic.go:356] "Generic (PLEG): container finished" podID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerID="6e851ad3835a31d35e2475caf5b02a4c32516129fd2955d08e20af84ae583602" exitCode=0 Jul 22 01:51:04.855484 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:04.855048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" event={"ID":"c49fe75a-e876-46a2-9be2-35b2d1f73a26","Type":"ContainerDied","Data":"6e851ad3835a31d35e2475caf5b02a4c32516129fd2955d08e20af84ae583602"} Jul 22 01:51:04.856995 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:04.856969 2579 generic.go:356] "Generic (PLEG): container finished" podID="dd75a623-9db2-4cc1-9605-ec992241481e" containerID="2083d83a04b1b3af8af9f7dfa9434b2bfc034c20a052f6f00b61b12e896039e7" exitCode=0 Jul 22 01:51:04.857098 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:04.857053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" event={"ID":"dd75a623-9db2-4cc1-9605-ec992241481e","Type":"ContainerDied","Data":"2083d83a04b1b3af8af9f7dfa9434b2bfc034c20a052f6f00b61b12e896039e7"} Jul 22 01:51:04.859135 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:04.859112 2579 generic.go:356] "Generic (PLEG): container finished" podID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerID="ec516ab5abc034784096ffa1a9253d16e0a38a7c0ff258fd33082356620d981e" exitCode=0 Jul 22 01:51:04.859223 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:04.859145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" event={"ID":"6fb73ba1-713d-4ba0-9a33-3315197dcbfa","Type":"ContainerDied","Data":"ec516ab5abc034784096ffa1a9253d16e0a38a7c0ff258fd33082356620d981e"} Jul 22 01:51:05.866331 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.866294 2579 generic.go:356] "Generic (PLEG): container finished" podID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerID="152acf9e433549aec823dfb6002dafc9857d5517c2495db5ca5a869852b1595d" exitCode=0 Jul 22 01:51:05.866757 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.866377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" event={"ID":"6fb73ba1-713d-4ba0-9a33-3315197dcbfa","Type":"ContainerDied","Data":"152acf9e433549aec823dfb6002dafc9857d5517c2495db5ca5a869852b1595d"} Jul 22 01:51:05.868246 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.868226 2579 generic.go:356] "Generic (PLEG): container finished" podID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerID="92578b830d755b328d87aa0270101ecb878693db953d4e92f1edff1ccd2859c0" exitCode=0 Jul 22 01:51:05.868357 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.868293 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" event={"ID":"c49fe75a-e876-46a2-9be2-35b2d1f73a26","Type":"ContainerDied","Data":"92578b830d755b328d87aa0270101ecb878693db953d4e92f1edff1ccd2859c0"} Jul 22 01:51:05.870517 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.870498 2579 generic.go:356] "Generic (PLEG): container finished" podID="dd75a623-9db2-4cc1-9605-ec992241481e" containerID="7962d5b19135378660514644475949ef5dafc8d1ef98e0bba8f91f26cd82d002" exitCode=0 Jul 22 01:51:05.870600 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.870533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" event={"ID":"dd75a623-9db2-4cc1-9605-ec992241481e","Type":"ContainerDied","Data":"7962d5b19135378660514644475949ef5dafc8d1ef98e0bba8f91f26cd82d002"} Jul 22 01:51:05.872287 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.872269 2579 generic.go:356] "Generic (PLEG): container finished" podID="fc975532-22e2-492e-9c13-176575e4decd" containerID="3d363c0b253c06db6c19daf0b679f32139f5ae29e7827f7dab519039417be735" exitCode=0 Jul 22 01:51:05.872361 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:05.872341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" event={"ID":"fc975532-22e2-492e-9c13-176575e4decd","Type":"ContainerDied","Data":"3d363c0b253c06db6c19daf0b679f32139f5ae29e7827f7dab519039417be735"} Jul 22 01:51:06.879477 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:06.879443 2579 generic.go:356] "Generic (PLEG): container finished" podID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerID="01188a91b293ce6d117e4dd6a739b59d56f24f8fe9ef12c4a75d2aa41730ff4a" exitCode=0 Jul 22 01:51:06.879914 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:06.879527 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" event={"ID":"c49fe75a-e876-46a2-9be2-35b2d1f73a26","Type":"ContainerDied","Data":"01188a91b293ce6d117e4dd6a739b59d56f24f8fe9ef12c4a75d2aa41730ff4a"} Jul 22 01:51:06.881448 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:06.881425 2579 generic.go:356] "Generic (PLEG): container finished" podID="fc975532-22e2-492e-9c13-176575e4decd" containerID="7160d1ee1e316dc20c18d30878febed32ff83cbdb825fb4307f4ed3fefb50ad9" exitCode=0 Jul 22 01:51:06.881545 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:06.881495 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" event={"ID":"fc975532-22e2-492e-9c13-176575e4decd","Type":"ContainerDied","Data":"7160d1ee1e316dc20c18d30878febed32ff83cbdb825fb4307f4ed3fefb50ad9"} Jul 22 01:51:07.016902 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.016876 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:07.047499 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.047474 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:07.053795 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.053775 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-bundle\") pod \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " Jul 22 01:51:07.053883 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.053823 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-util\") pod \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " Jul 22 01:51:07.053883 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.053854 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-bundle\") pod \"dd75a623-9db2-4cc1-9605-ec992241481e\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " Jul 22 01:51:07.053994 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.053884 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh7dk\" (UniqueName: \"kubernetes.io/projected/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-kube-api-access-hh7dk\") pod \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\" (UID: \"6fb73ba1-713d-4ba0-9a33-3315197dcbfa\") " Jul 22 01:51:07.053994 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.053968 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98ps2\" (UniqueName: \"kubernetes.io/projected/dd75a623-9db2-4cc1-9605-ec992241481e-kube-api-access-98ps2\") pod \"dd75a623-9db2-4cc1-9605-ec992241481e\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " Jul 22 01:51:07.054088 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.054013 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-util\") pod \"dd75a623-9db2-4cc1-9605-ec992241481e\" (UID: \"dd75a623-9db2-4cc1-9605-ec992241481e\") " Jul 22 01:51:07.054620 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.054528 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-bundle" (OuterVolumeSpecName: "bundle") pod "6fb73ba1-713d-4ba0-9a33-3315197dcbfa" (UID: "6fb73ba1-713d-4ba0-9a33-3315197dcbfa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:07.054620 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.054563 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-bundle" (OuterVolumeSpecName: "bundle") pod "dd75a623-9db2-4cc1-9605-ec992241481e" (UID: "dd75a623-9db2-4cc1-9605-ec992241481e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:07.056294 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.056269 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-kube-api-access-hh7dk" (OuterVolumeSpecName: "kube-api-access-hh7dk") pod "6fb73ba1-713d-4ba0-9a33-3315197dcbfa" (UID: "6fb73ba1-713d-4ba0-9a33-3315197dcbfa"). InnerVolumeSpecName "kube-api-access-hh7dk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:51:07.056452 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.056428 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd75a623-9db2-4cc1-9605-ec992241481e-kube-api-access-98ps2" (OuterVolumeSpecName: "kube-api-access-98ps2") pod "dd75a623-9db2-4cc1-9605-ec992241481e" (UID: "dd75a623-9db2-4cc1-9605-ec992241481e"). InnerVolumeSpecName "kube-api-access-98ps2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:51:07.060143 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.060123 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-util" (OuterVolumeSpecName: "util") pod "6fb73ba1-713d-4ba0-9a33-3315197dcbfa" (UID: "6fb73ba1-713d-4ba0-9a33-3315197dcbfa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:07.062359 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.062339 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-util" (OuterVolumeSpecName: "util") pod "dd75a623-9db2-4cc1-9605-ec992241481e" (UID: "dd75a623-9db2-4cc1-9605-ec992241481e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:07.155685 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.155602 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-bundle\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:07.155685 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.155631 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-util\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:07.155685 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.155639 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-bundle\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:07.155685 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.155650 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh7dk\" (UniqueName: \"kubernetes.io/projected/6fb73ba1-713d-4ba0-9a33-3315197dcbfa-kube-api-access-hh7dk\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:07.155685 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.155661 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ps2\" (UniqueName: \"kubernetes.io/projected/dd75a623-9db2-4cc1-9605-ec992241481e-kube-api-access-98ps2\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:07.155685 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.155669 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd75a623-9db2-4cc1-9605-ec992241481e-util\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:07.888429 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.888398 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" Jul 22 01:51:07.888951 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.888426 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x" event={"ID":"6fb73ba1-713d-4ba0-9a33-3315197dcbfa","Type":"ContainerDied","Data":"730e866f27c67ce42fa805f35e88b46b31d21ad28cf1e93b4aa483d77abe3341"} Jul 22 01:51:07.888951 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.888482 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="730e866f27c67ce42fa805f35e88b46b31d21ad28cf1e93b4aa483d77abe3341" Jul 22 01:51:07.890189 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.890170 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" Jul 22 01:51:07.890313 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.890201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc" event={"ID":"dd75a623-9db2-4cc1-9605-ec992241481e","Type":"ContainerDied","Data":"a4466b865b9af8460313c5287276e95bd58fd09f89b527a1160e5b3eccf77ec6"} Jul 22 01:51:07.890313 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:07.890238 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4466b865b9af8460313c5287276e95bd58fd09f89b527a1160e5b3eccf77ec6" Jul 22 01:51:08.046882 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.046861 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:08.048914 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.048898 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:08.066010 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.065981 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-util\") pod \"fc975532-22e2-492e-9c13-176575e4decd\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " Jul 22 01:51:08.066164 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.066030 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgzw7\" (UniqueName: \"kubernetes.io/projected/c49fe75a-e876-46a2-9be2-35b2d1f73a26-kube-api-access-kgzw7\") pod \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " Jul 22 01:51:08.066164 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.066060 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-util\") pod \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " Jul 22 01:51:08.066164 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.066099 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-bundle\") pod \"fc975532-22e2-492e-9c13-176575e4decd\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " Jul 22 01:51:08.066164 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.066130 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-bundle\") pod \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\" (UID: \"c49fe75a-e876-46a2-9be2-35b2d1f73a26\") " Jul 22 01:51:08.066436 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.066198 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wsh6\" (UniqueName: \"kubernetes.io/projected/fc975532-22e2-492e-9c13-176575e4decd-kube-api-access-7wsh6\") pod \"fc975532-22e2-492e-9c13-176575e4decd\" (UID: \"fc975532-22e2-492e-9c13-176575e4decd\") " Jul 22 01:51:08.067042 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.066998 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-bundle" (OuterVolumeSpecName: "bundle") pod "fc975532-22e2-492e-9c13-176575e4decd" (UID: "fc975532-22e2-492e-9c13-176575e4decd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:08.067341 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.067292 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-bundle" (OuterVolumeSpecName: "bundle") pod "c49fe75a-e876-46a2-9be2-35b2d1f73a26" (UID: "c49fe75a-e876-46a2-9be2-35b2d1f73a26"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:08.068533 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.068495 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49fe75a-e876-46a2-9be2-35b2d1f73a26-kube-api-access-kgzw7" (OuterVolumeSpecName: "kube-api-access-kgzw7") pod "c49fe75a-e876-46a2-9be2-35b2d1f73a26" (UID: "c49fe75a-e876-46a2-9be2-35b2d1f73a26"). InnerVolumeSpecName "kube-api-access-kgzw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:51:08.069764 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.069725 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc975532-22e2-492e-9c13-176575e4decd-kube-api-access-7wsh6" (OuterVolumeSpecName: "kube-api-access-7wsh6") pod "fc975532-22e2-492e-9c13-176575e4decd" (UID: "fc975532-22e2-492e-9c13-176575e4decd"). InnerVolumeSpecName "kube-api-access-7wsh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:51:08.075140 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.075116 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-util" (OuterVolumeSpecName: "util") pod "c49fe75a-e876-46a2-9be2-35b2d1f73a26" (UID: "c49fe75a-e876-46a2-9be2-35b2d1f73a26"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:08.075140 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.075129 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-util" (OuterVolumeSpecName: "util") pod "fc975532-22e2-492e-9c13-176575e4decd" (UID: "fc975532-22e2-492e-9c13-176575e4decd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:51:08.167862 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.167769 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-util\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:08.167862 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.167801 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgzw7\" (UniqueName: \"kubernetes.io/projected/c49fe75a-e876-46a2-9be2-35b2d1f73a26-kube-api-access-kgzw7\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:08.167862 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.167815 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-util\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:08.167862 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.167828 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc975532-22e2-492e-9c13-176575e4decd-bundle\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:08.167862 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.167839 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c49fe75a-e876-46a2-9be2-35b2d1f73a26-bundle\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:08.167862 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.167851 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wsh6\" (UniqueName: \"kubernetes.io/projected/fc975532-22e2-492e-9c13-176575e4decd-kube-api-access-7wsh6\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:51:08.897248 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.897218 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" Jul 22 01:51:08.897661 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.897217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq" event={"ID":"c49fe75a-e876-46a2-9be2-35b2d1f73a26","Type":"ContainerDied","Data":"eb653fd2c8f68074e5b36f9d0f9042908b10859a764dbc2a6948ecbedea28f8f"} Jul 22 01:51:08.897661 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.897356 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb653fd2c8f68074e5b36f9d0f9042908b10859a764dbc2a6948ecbedea28f8f" Jul 22 01:51:08.899035 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.899018 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" Jul 22 01:51:08.899035 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.899021 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w" event={"ID":"fc975532-22e2-492e-9c13-176575e4decd","Type":"ContainerDied","Data":"c844b1cf1eb21b472d64e3f693205da544a1c8fc943f17a09cf66f5ab9de8176"} Jul 22 01:51:08.899161 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:51:08.899059 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c844b1cf1eb21b472d64e3f693205da544a1c8fc943f17a09cf66f5ab9de8176" Jul 22 01:52:29.854635 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854598 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854923 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc975532-22e2-492e-9c13-176575e4decd" containerName="util" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854935 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc975532-22e2-492e-9c13-176575e4decd" containerName="util" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854956 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerName="util" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854961 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerName="util" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854969 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerName="util" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854975 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerName="util" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854980 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854985 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854993 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc975532-22e2-492e-9c13-176575e4decd" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.854998 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc975532-22e2-492e-9c13-176575e4decd" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855006 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855013 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855023 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd75a623-9db2-4cc1-9605-ec992241481e" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855028 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd75a623-9db2-4cc1-9605-ec992241481e" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855033 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855039 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerName="pull" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855045 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd75a623-9db2-4cc1-9605-ec992241481e" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855050 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd75a623-9db2-4cc1-9605-ec992241481e" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855055 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc975532-22e2-492e-9c13-176575e4decd" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855059 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc975532-22e2-492e-9c13-176575e4decd" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855066 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855071 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerName="extract" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855079 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd75a623-9db2-4cc1-9605-ec992241481e" containerName="util" Jul 22 01:52:29.855111 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855083 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd75a623-9db2-4cc1-9605-ec992241481e" containerName="util" Jul 22 01:52:29.855829 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855134 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc975532-22e2-492e-9c13-176575e4decd" containerName="extract" Jul 22 01:52:29.855829 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855142 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd75a623-9db2-4cc1-9605-ec992241481e" containerName="extract" Jul 22 01:52:29.855829 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855149 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb73ba1-713d-4ba0-9a33-3315197dcbfa" containerName="extract" Jul 22 01:52:29.855829 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.855156 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c49fe75a-e876-46a2-9be2-35b2d1f73a26" containerName="extract" Jul 22 01:52:29.858245 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.858229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:29.860335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.860310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 01:52:29.860335 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.860328 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 01:52:29.860490 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.860318 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 01:52:29.860894 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.860879 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-clbcz\"" Jul 22 01:52:29.865404 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.865360 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:52:29.892619 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.892591 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:52:29.932132 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.932102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnm8x\" (UniqueName: \"kubernetes.io/projected/8f715ac2-2e75-485e-8044-35939459a27b-kube-api-access-hnm8x\") pod \"limitador-limitador-54d6d988d5-jc4xg\" (UID: \"8f715ac2-2e75-485e-8044-35939459a27b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:29.932297 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:29.932154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f715ac2-2e75-485e-8044-35939459a27b-config-file\") pod \"limitador-limitador-54d6d988d5-jc4xg\" (UID: \"8f715ac2-2e75-485e-8044-35939459a27b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:30.033491 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.033452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f715ac2-2e75-485e-8044-35939459a27b-config-file\") pod \"limitador-limitador-54d6d988d5-jc4xg\" (UID: \"8f715ac2-2e75-485e-8044-35939459a27b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:30.033672 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.033525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnm8x\" (UniqueName: \"kubernetes.io/projected/8f715ac2-2e75-485e-8044-35939459a27b-kube-api-access-hnm8x\") pod \"limitador-limitador-54d6d988d5-jc4xg\" (UID: \"8f715ac2-2e75-485e-8044-35939459a27b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:30.034205 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.034169 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f715ac2-2e75-485e-8044-35939459a27b-config-file\") pod \"limitador-limitador-54d6d988d5-jc4xg\" (UID: \"8f715ac2-2e75-485e-8044-35939459a27b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:30.042368 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.042342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnm8x\" (UniqueName: \"kubernetes.io/projected/8f715ac2-2e75-485e-8044-35939459a27b-kube-api-access-hnm8x\") pod \"limitador-limitador-54d6d988d5-jc4xg\" (UID: \"8f715ac2-2e75-485e-8044-35939459a27b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:30.169260 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.169177 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:30.311910 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.311823 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:52:30.314548 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:52:30.314521 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f715ac2_2e75_485e_8044_35939459a27b.slice/crio-188dc51338230428066c4d5d75fcbac62b5b7c215a8700aeceaaf4c5d0d925f7 WatchSource:0}: Error finding container 188dc51338230428066c4d5d75fcbac62b5b7c215a8700aeceaaf4c5d0d925f7: Status 404 returned error can't find the container with id 188dc51338230428066c4d5d75fcbac62b5b7c215a8700aeceaaf4c5d0d925f7 Jul 22 01:52:30.618565 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.618531 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvddg"] Jul 22 01:52:30.622861 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.622845 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvddg" Jul 22 01:52:30.625340 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.625318 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-24slz\"" Jul 22 01:52:30.628721 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.628697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvddg"] Jul 22 01:52:30.740216 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.740175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgzbg\" (UniqueName: \"kubernetes.io/projected/108759a6-8598-4288-a3f1-9dd44c085794-kube-api-access-rgzbg\") pod \"authorino-75d556bd77-bvddg\" (UID: \"108759a6-8598-4288-a3f1-9dd44c085794\") " pod="kuadrant-system/authorino-75d556bd77-bvddg" Jul 22 01:52:30.841260 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.841228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzbg\" (UniqueName: \"kubernetes.io/projected/108759a6-8598-4288-a3f1-9dd44c085794-kube-api-access-rgzbg\") pod \"authorino-75d556bd77-bvddg\" (UID: \"108759a6-8598-4288-a3f1-9dd44c085794\") " pod="kuadrant-system/authorino-75d556bd77-bvddg" Jul 22 01:52:30.849684 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.849660 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgzbg\" (UniqueName: \"kubernetes.io/projected/108759a6-8598-4288-a3f1-9dd44c085794-kube-api-access-rgzbg\") pod \"authorino-75d556bd77-bvddg\" (UID: \"108759a6-8598-4288-a3f1-9dd44c085794\") " pod="kuadrant-system/authorino-75d556bd77-bvddg" Jul 22 01:52:30.932963 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:30.932637 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvddg" Jul 22 01:52:31.129832 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:31.129802 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvddg"] Jul 22 01:52:31.309239 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:31.309147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" event={"ID":"8f715ac2-2e75-485e-8044-35939459a27b","Type":"ContainerStarted","Data":"188dc51338230428066c4d5d75fcbac62b5b7c215a8700aeceaaf4c5d0d925f7"} Jul 22 01:52:31.310557 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:31.310530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvddg" event={"ID":"108759a6-8598-4288-a3f1-9dd44c085794","Type":"ContainerStarted","Data":"57bf4776f8c6b9426b3cfaa0e6e794f6a861a4871e2facaf8b1482cffca9deb7"} Jul 22 01:52:35.335907 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:35.335874 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvddg" event={"ID":"108759a6-8598-4288-a3f1-9dd44c085794","Type":"ContainerStarted","Data":"c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e"} Jul 22 01:52:35.337376 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:35.337347 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" event={"ID":"8f715ac2-2e75-485e-8044-35939459a27b","Type":"ContainerStarted","Data":"4092d5c6ecf8a63b5a378c7da3b53e4138207c8148e40b7fc730b6fe8477249d"} Jul 22 01:52:35.337510 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:35.337448 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:52:35.350485 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:35.350443 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bvddg" podStartSLOduration=1.695857513 podStartE2EDuration="5.350429828s" totalImagesPullingTime="3.654572315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:52:35.348340248 +0000 UTC m=+474.899553947" watchObservedRunningTime="2026-07-22 01:52:35.350429828 +0000 UTC m=+474.901643518" Jul 22 01:52:35.364509 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:35.364448 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" podStartSLOduration=1.896370382 podStartE2EDuration="6.364429499s" totalImagesPullingTime="4.468059117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:52:35.362620532 +0000 UTC m=+474.913834246" watchObservedRunningTime="2026-07-22 01:52:35.364429499 +0000 UTC m=+474.915643212" Jul 22 01:52:46.344411 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:52:46.344381 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jc4xg" Jul 22 01:53:06.172647 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.172612 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvddg"] Jul 22 01:53:06.173121 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.172798 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bvddg" podUID="108759a6-8598-4288-a3f1-9dd44c085794" containerName="authorino" containerID="cri-o://c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e" gracePeriod=30 Jul 22 01:53:06.426350 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.426288 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvddg" Jul 22 01:53:06.431861 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.431838 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgzbg\" (UniqueName: \"kubernetes.io/projected/108759a6-8598-4288-a3f1-9dd44c085794-kube-api-access-rgzbg\") pod \"108759a6-8598-4288-a3f1-9dd44c085794\" (UID: \"108759a6-8598-4288-a3f1-9dd44c085794\") " Jul 22 01:53:06.433815 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.433785 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/108759a6-8598-4288-a3f1-9dd44c085794-kube-api-access-rgzbg" (OuterVolumeSpecName: "kube-api-access-rgzbg") pod "108759a6-8598-4288-a3f1-9dd44c085794" (UID: "108759a6-8598-4288-a3f1-9dd44c085794"). InnerVolumeSpecName "kube-api-access-rgzbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:53:06.491284 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.491245 2579 generic.go:356] "Generic (PLEG): container finished" podID="108759a6-8598-4288-a3f1-9dd44c085794" containerID="c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e" exitCode=0 Jul 22 01:53:06.491435 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.491295 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvddg" Jul 22 01:53:06.491435 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.491305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvddg" event={"ID":"108759a6-8598-4288-a3f1-9dd44c085794","Type":"ContainerDied","Data":"c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e"} Jul 22 01:53:06.491435 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.491343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvddg" event={"ID":"108759a6-8598-4288-a3f1-9dd44c085794","Type":"ContainerDied","Data":"57bf4776f8c6b9426b3cfaa0e6e794f6a861a4871e2facaf8b1482cffca9deb7"} Jul 22 01:53:06.491435 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.491365 2579 scope.go:117] "RemoveContainer" containerID="c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e" Jul 22 01:53:06.500353 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.500329 2579 scope.go:117] "RemoveContainer" containerID="c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e" Jul 22 01:53:06.500596 ip-10-0-141-12 kubenswrapper[2579]: E0722 01:53:06.500575 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e\": container with ID starting with c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e not found: ID does not exist" containerID="c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e" Jul 22 01:53:06.500654 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.500605 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e"} err="failed to get container status \"c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e\": rpc error: code = NotFound desc = could not find container \"c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e\": container with ID starting with c196d25bde7f5a6fda421f2cd0f649218e451756eca8a971dee640c4c115c09e not found: ID does not exist" Jul 22 01:53:06.510895 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.510867 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvddg"] Jul 22 01:53:06.514578 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.514558 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvddg"] Jul 22 01:53:06.532377 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.532358 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgzbg\" (UniqueName: \"kubernetes.io/projected/108759a6-8598-4288-a3f1-9dd44c085794-kube-api-access-rgzbg\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 01:53:06.970558 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:06.970524 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="108759a6-8598-4288-a3f1-9dd44c085794" path="/var/lib/kubelet/pods/108759a6-8598-4288-a3f1-9dd44c085794/volumes" Jul 22 01:53:47.498497 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:53:47.498459 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:54:03.789252 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:03.789216 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:54:10.197268 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:10.197236 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:54:23.593414 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:23.593371 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:54:28.396990 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.396954 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d"] Jul 22 01:54:28.397478 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.397453 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="108759a6-8598-4288-a3f1-9dd44c085794" containerName="authorino" Jul 22 01:54:28.397478 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.397479 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="108759a6-8598-4288-a3f1-9dd44c085794" containerName="authorino" Jul 22 01:54:28.397626 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.397602 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="108759a6-8598-4288-a3f1-9dd44c085794" containerName="authorino" Jul 22 01:54:28.400997 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.400976 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.403056 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.403037 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 01:54:28.403438 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.403419 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 01:54:28.403506 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.403434 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8bf95\"" Jul 22 01:54:28.403506 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.403419 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 01:54:28.407689 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.407666 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d"] Jul 22 01:54:28.477253 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.477220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f31988-f857-4b57-89fb-e65c741bba11-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.477253 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.477253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.477443 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.477273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9hxh\" (UniqueName: \"kubernetes.io/projected/95f31988-f857-4b57-89fb-e65c741bba11-kube-api-access-h9hxh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.477443 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.477290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.477443 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.477313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.477443 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.477361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578271 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f31988-f857-4b57-89fb-e65c741bba11-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578271 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9hxh\" (UniqueName: \"kubernetes.io/projected/95f31988-f857-4b57-89fb-e65c741bba11-kube-api-access-h9hxh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578505 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578705 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578809 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.578851 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.578809 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.580500 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.580480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95f31988-f857-4b57-89fb-e65c741bba11-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.580776 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.580739 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95f31988-f857-4b57-89fb-e65c741bba11-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.585822 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.585795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9hxh\" (UniqueName: \"kubernetes.io/projected/95f31988-f857-4b57-89fb-e65c741bba11-kube-api-access-h9hxh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d\" (UID: \"95f31988-f857-4b57-89fb-e65c741bba11\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.713245 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.713168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:28.841041 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.841018 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d"] Jul 22 01:54:28.842954 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:54:28.842926 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f31988_f857_4b57_89fb_e65c741bba11.slice/crio-45d4e1e485d7ddca9a092546d61fb8cb0b6b651c2837f8631348f34b9c103736 WatchSource:0}: Error finding container 45d4e1e485d7ddca9a092546d61fb8cb0b6b651c2837f8631348f34b9c103736: Status 404 returned error can't find the container with id 45d4e1e485d7ddca9a092546d61fb8cb0b6b651c2837f8631348f34b9c103736 Jul 22 01:54:28.910207 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:28.910180 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" event={"ID":"95f31988-f857-4b57-89fb-e65c741bba11","Type":"ContainerStarted","Data":"45d4e1e485d7ddca9a092546d61fb8cb0b6b651c2837f8631348f34b9c103736"} Jul 22 01:54:29.916465 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:29.916431 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" event={"ID":"95f31988-f857-4b57-89fb-e65c741bba11","Type":"ContainerStarted","Data":"638ecd3f4b95014ac5a5113a8f9dab03b514450d0b4373015b4f7a27228a0a81"} Jul 22 01:54:29.932520 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:29.932476 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" podStartSLOduration=0.953444229 podStartE2EDuration="1.932459815s" totalImagesPullingTime="979.015586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:54:29.931627637 +0000 UTC m=+589.482841345" watchObservedRunningTime="2026-07-22 01:54:29.932459815 +0000 UTC m=+589.483673527" Jul 22 01:54:29.999711 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:29.999681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:54:38.301598 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:38.301562 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:54:38.714079 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:38.714051 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:38.714240 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:38.714200 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:38.727322 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:38.727297 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:38.976882 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:38.976799 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d" Jul 22 01:54:40.921688 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:40.921662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:54:40.922269 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:40.921888 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:54:40.926090 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:40.926067 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:54:40.926412 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:40.926395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:54:52.691365 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:54:52.691324 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:55:47.715444 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.715410 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c5656c7c8-57mgf"] Jul 22 01:55:47.718718 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.718701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:47.720919 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.720901 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 01:55:47.721070 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.721055 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-24slz\"" Jul 22 01:55:47.725946 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.725849 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5656c7c8-57mgf"] Jul 22 01:55:47.802525 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.802491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35f37ff4-2e7d-4f14-87cd-a586b704fa9c-tls-cert\") pod \"authorino-5c5656c7c8-57mgf\" (UID: \"35f37ff4-2e7d-4f14-87cd-a586b704fa9c\") " pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:47.802635 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.802537 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97w2v\" (UniqueName: \"kubernetes.io/projected/35f37ff4-2e7d-4f14-87cd-a586b704fa9c-kube-api-access-97w2v\") pod \"authorino-5c5656c7c8-57mgf\" (UID: \"35f37ff4-2e7d-4f14-87cd-a586b704fa9c\") " pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:47.903035 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.903010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35f37ff4-2e7d-4f14-87cd-a586b704fa9c-tls-cert\") pod \"authorino-5c5656c7c8-57mgf\" (UID: \"35f37ff4-2e7d-4f14-87cd-a586b704fa9c\") " pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:47.903145 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.903058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97w2v\" (UniqueName: \"kubernetes.io/projected/35f37ff4-2e7d-4f14-87cd-a586b704fa9c-kube-api-access-97w2v\") pod \"authorino-5c5656c7c8-57mgf\" (UID: \"35f37ff4-2e7d-4f14-87cd-a586b704fa9c\") " pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:47.905616 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.905596 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35f37ff4-2e7d-4f14-87cd-a586b704fa9c-tls-cert\") pod \"authorino-5c5656c7c8-57mgf\" (UID: \"35f37ff4-2e7d-4f14-87cd-a586b704fa9c\") " pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:47.911205 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:47.911186 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97w2v\" (UniqueName: \"kubernetes.io/projected/35f37ff4-2e7d-4f14-87cd-a586b704fa9c-kube-api-access-97w2v\") pod \"authorino-5c5656c7c8-57mgf\" (UID: \"35f37ff4-2e7d-4f14-87cd-a586b704fa9c\") " pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:48.028790 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:48.028721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5656c7c8-57mgf" Jul 22 01:55:48.163633 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:48.163609 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5656c7c8-57mgf"] Jul 22 01:55:48.165971 ip-10-0-141-12 kubenswrapper[2579]: W0722 01:55:48.165939 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35f37ff4_2e7d_4f14_87cd_a586b704fa9c.slice/crio-ee393f949557525be9f73f67f03a3fc4bcf98c0f0053ba674eda1fd32b6382ee WatchSource:0}: Error finding container ee393f949557525be9f73f67f03a3fc4bcf98c0f0053ba674eda1fd32b6382ee: Status 404 returned error can't find the container with id ee393f949557525be9f73f67f03a3fc4bcf98c0f0053ba674eda1fd32b6382ee Jul 22 01:55:48.167690 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:48.167675 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:55:48.309886 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:48.309818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5656c7c8-57mgf" event={"ID":"35f37ff4-2e7d-4f14-87cd-a586b704fa9c","Type":"ContainerStarted","Data":"ee393f949557525be9f73f67f03a3fc4bcf98c0f0053ba674eda1fd32b6382ee"} Jul 22 01:55:49.316423 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:49.316388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5656c7c8-57mgf" event={"ID":"35f37ff4-2e7d-4f14-87cd-a586b704fa9c","Type":"ContainerStarted","Data":"419225a970b0bb03f8ad407a498be8d5afdbeaffed2c02d29fe2b9a7e7b72512"} Jul 22 01:55:49.333711 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:55:49.333658 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c5656c7c8-57mgf" podStartSLOduration=1.931149241 podStartE2EDuration="2.333643093s" totalImagesPullingTime="402.493852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:55:49.333039814 +0000 UTC m=+668.884253532" watchObservedRunningTime="2026-07-22 01:55:49.333643093 +0000 UTC m=+668.884856805" Jul 22 01:56:19.096402 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:56:19.096363 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:56:27.991737 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:56:27.991702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:56:38.895450 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:56:38.895373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:58:21.016721 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:58:21.016643 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:58:32.490635 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:58:32.490600 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:59:06.996339 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:06.996306 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:59:16.794326 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:16.794295 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:59:25.196709 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:25.196677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:59:35.690421 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:35.690343 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:59:40.957875 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:40.957852 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:59:40.959626 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:40.959601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 01:59:40.962481 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:40.962460 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:59:40.964369 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:40.964351 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 01:59:44.213040 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:44.213004 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 01:59:53.204424 ip-10-0-141-12 kubenswrapper[2579]: I0722 01:59:53.204391 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:00:00.146965 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:00.146929 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9"] Jul 22 02:00:00.150362 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:00.150346 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" Jul 22 02:00:00.152485 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:00.152466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qmc8m\"" Jul 22 02:00:00.159432 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:00.159418 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" Jul 22 02:00:00.165972 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:00.165937 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9"] Jul 22 02:00:00.495479 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:00.495457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9"] Jul 22 02:00:00.497520 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:00:00.497481 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b729f9_3083_4185_9ff2_341366159f88.slice/crio-ffb06f17604ec1e00b457ef8446ad662b5a7ac4e2759be9bd4e329c587368ee3 WatchSource:0}: Error finding container ffb06f17604ec1e00b457ef8446ad662b5a7ac4e2759be9bd4e329c587368ee3: Status 404 returned error can't find the container with id ffb06f17604ec1e00b457ef8446ad662b5a7ac4e2759be9bd4e329c587368ee3 Jul 22 02:00:00.603527 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:00.603503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" event={"ID":"65b729f9-3083-4185-9ff2-341366159f88","Type":"ContainerStarted","Data":"ffb06f17604ec1e00b457ef8446ad662b5a7ac4e2759be9bd4e329c587368ee3"} Jul 22 02:00:04.291573 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:04.291537 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:00:14.390085 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:14.390053 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:00:19.710050 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:19.710008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" event={"ID":"65b729f9-3083-4185-9ff2-341366159f88","Type":"ContainerStarted","Data":"a6a71a0dbc624416c7fd2d9caa1884ba5b8ea868a17b00759ec600f023e6102e"} Jul 22 02:00:19.736568 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:19.736524 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" podStartSLOduration=1.002447724 podStartE2EDuration="19.736509729s" totalImagesPullingTime="18.734062005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:00:19.734241085 +0000 UTC m=+939.285454799" watchObservedRunningTime="2026-07-22 02:00:19.736509729 +0000 UTC m=+939.287723442" Jul 22 02:00:20.716792 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:20.716732 2579 generic.go:356] "Generic (PLEG): container finished" podID="65b729f9-3083-4185-9ff2-341366159f88" containerID="a6a71a0dbc624416c7fd2d9caa1884ba5b8ea868a17b00759ec600f023e6102e" exitCode=0 Jul 22 02:00:20.717176 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:20.716817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" event={"ID":"65b729f9-3083-4185-9ff2-341366159f88","Type":"ContainerDied","Data":"a6a71a0dbc624416c7fd2d9caa1884ba5b8ea868a17b00759ec600f023e6102e"} Jul 22 02:00:21.854167 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:21.854146 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" Jul 22 02:00:22.728489 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:22.728462 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" Jul 22 02:00:22.728489 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:22.728473 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-7hcc9" event={"ID":"65b729f9-3083-4185-9ff2-341366159f88","Type":"ContainerDied","Data":"ffb06f17604ec1e00b457ef8446ad662b5a7ac4e2759be9bd4e329c587368ee3"} Jul 22 02:00:22.728679 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:22.728515 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffb06f17604ec1e00b457ef8446ad662b5a7ac4e2759be9bd4e329c587368ee3" Jul 22 02:00:36.906403 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:36.906365 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:00:46.008351 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:00:46.008320 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:01:09.602375 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:01:09.602299 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:01:22.195138 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:01:22.195107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:01:37.601907 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:01:37.601873 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:01:46.904739 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:01:46.904703 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:01:56.302466 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:01:56.302428 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:02:05.494046 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:02:05.494014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:02:14.790639 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:02:14.790607 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:04:04.801555 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:04.801475 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:04:14.796171 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:14.796131 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:04:25.193489 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:25.193420 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:04:38.499574 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:38.499539 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:04:40.995648 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:40.995612 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:04:40.996358 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:40.996340 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:04:40.999902 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:40.999887 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:04:41.000371 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:41.000353 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:04:47.704798 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:47.704764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:04:58.308106 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:04:58.308071 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:05:07.198161 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:05:07.198127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:05:17.692947 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:05:17.692908 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:05:29.306950 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:05:29.306914 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:05:38.994558 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:05:38.994479 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:05:49.194174 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:05:49.194139 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:06:13.599338 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:06:13.599302 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:06:21.193987 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:06:21.193950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:06:35.591899 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:06:35.591859 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:06:59.604813 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:06:59.604775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:07:13.632598 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:07:13.632510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:07:21.419575 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:07:21.419541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:07:37.664732 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:07:37.664691 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:07:47.017405 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:07:47.017371 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:07:56.206702 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:07:56.206665 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:08:04.843758 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:08:04.843715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:08:15.606108 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:08:15.606074 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:08:24.906683 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:08:24.906647 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:08:38.096618 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:08:38.096539 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:08:46.939274 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:08:46.939234 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:08:56.200082 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:08:56.200046 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:09:08.497319 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:08.497274 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:09:19.596305 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:19.596266 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:09:28.799490 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:28.799454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:09:39.896856 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:39.896818 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:09:41.039650 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:41.039623 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:09:41.040127 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:41.040047 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:09:41.044033 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:41.044012 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:09:41.044336 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:41.044314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:09:51.297956 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:09:51.297921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:10:00.296936 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:10:00.296901 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:10:14.204109 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:10:14.204030 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:10:23.391440 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:10:23.391399 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:10:33.003807 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:10:33.003773 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:10:43.892454 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:10:43.892413 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:11:25.501606 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:11:25.501574 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:11:35.896227 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:11:35.896151 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:12:09.502255 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:12:09.502221 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:12:20.601720 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:12:20.601684 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:12:54.893305 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:12:54.893271 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:13:06.795930 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:13:06.795856 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:13:39.897003 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:13:39.896963 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:14:41.077535 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:14:41.077504 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:14:41.079447 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:14:41.079425 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:14:41.081587 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:14:41.081565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:14:41.083372 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:14:41.083354 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:15:09.805450 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:15:09.805419 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:15:20.814980 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:15:20.814927 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:15:30.901924 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:15:30.901881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:15:41.902783 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:15:41.902734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:15:56.788706 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:15:56.788670 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:16:32.389901 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:32.389821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:16:41.899254 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:41.899216 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:16:53.997430 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:53.997396 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:16:56.562098 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.562063 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx"] Jul 22 02:16:56.562506 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.562410 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b729f9-3083-4185-9ff2-341366159f88" containerName="cleanup" Jul 22 02:16:56.562506 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.562422 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b729f9-3083-4185-9ff2-341366159f88" containerName="cleanup" Jul 22 02:16:56.562506 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.562477 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b729f9-3083-4185-9ff2-341366159f88" containerName="cleanup" Jul 22 02:16:56.565632 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.565615 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" Jul 22 02:16:56.567958 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.567938 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:16:56.568053 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.567968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qmc8m\"" Jul 22 02:16:56.573580 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.573552 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx"] Jul 22 02:16:56.685958 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.685920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af7f5698-0a40-4323-b782-85e1f85634de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx\" (UID: \"af7f5698-0a40-4323-b782-85e1f85634de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" Jul 22 02:16:56.786495 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.786461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af7f5698-0a40-4323-b782-85e1f85634de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx\" (UID: \"af7f5698-0a40-4323-b782-85e1f85634de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" Jul 22 02:16:56.787154 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.787133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af7f5698-0a40-4323-b782-85e1f85634de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx\" (UID: \"af7f5698-0a40-4323-b782-85e1f85634de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" Jul 22 02:16:56.876891 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:56.876855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" Jul 22 02:16:57.016279 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:57.016252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx"] Jul 22 02:16:57.018981 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:16:57.018944 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7f5698_0a40_4323_b782_85e1f85634de.slice/crio-7305955bb10971a08acd0cc66d93ab5bb32fe09f2827ae046f15ac60e9cfa621 WatchSource:0}: Error finding container 7305955bb10971a08acd0cc66d93ab5bb32fe09f2827ae046f15ac60e9cfa621: Status 404 returned error can't find the container with id 7305955bb10971a08acd0cc66d93ab5bb32fe09f2827ae046f15ac60e9cfa621 Jul 22 02:16:57.948101 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:57.948053 2579 generic.go:356] "Generic (PLEG): container finished" podID="af7f5698-0a40-4323-b782-85e1f85634de" containerID="4989f4c08251a97d7e8e40a43d151d066215dae8f824efdffda2380c6d577b68" exitCode=0 Jul 22 02:16:57.948561 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:57.948138 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" event={"ID":"af7f5698-0a40-4323-b782-85e1f85634de","Type":"ContainerDied","Data":"4989f4c08251a97d7e8e40a43d151d066215dae8f824efdffda2380c6d577b68"} Jul 22 02:16:57.948561 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:57.948185 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" event={"ID":"af7f5698-0a40-4323-b782-85e1f85634de","Type":"ContainerStarted","Data":"7305955bb10971a08acd0cc66d93ab5bb32fe09f2827ae046f15ac60e9cfa621"} Jul 22 02:16:59.080293 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:59.080267 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" Jul 22 02:16:59.206930 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:59.206836 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af7f5698-0a40-4323-b782-85e1f85634de-maas-api-service-ca\") pod \"af7f5698-0a40-4323-b782-85e1f85634de\" (UID: \"af7f5698-0a40-4323-b782-85e1f85634de\") " Jul 22 02:16:59.207206 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:59.207183 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af7f5698-0a40-4323-b782-85e1f85634de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af7f5698-0a40-4323-b782-85e1f85634de" (UID: "af7f5698-0a40-4323-b782-85e1f85634de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:16:59.307994 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:59.307960 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af7f5698-0a40-4323-b782-85e1f85634de-maas-api-service-ca\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:16:59.960404 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:59.960374 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" Jul 22 02:16:59.960620 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:59.960408 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx" event={"ID":"af7f5698-0a40-4323-b782-85e1f85634de","Type":"ContainerDied","Data":"7305955bb10971a08acd0cc66d93ab5bb32fe09f2827ae046f15ac60e9cfa621"} Jul 22 02:16:59.960620 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:16:59.960474 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7305955bb10971a08acd0cc66d93ab5bb32fe09f2827ae046f15ac60e9cfa621" Jul 22 02:17:10.299482 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:17:10.299443 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:17:16.661712 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:17:16.661649 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx"] Jul 22 02:17:16.663283 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:17:16.663258 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2f4841f-6rhbx"] Jul 22 02:17:16.971272 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:17:16.971192 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af7f5698-0a40-4323-b782-85e1f85634de" path="/var/lib/kubelet/pods/af7f5698-0a40-4323-b782-85e1f85634de/volumes" Jul 22 02:17:20.599363 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:17:20.599332 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:18:10.962077 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:18:10.962039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:18:20.504495 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:18:20.504460 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:19:12.295557 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:19:12.295484 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:19:22.802202 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:19:22.802170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:19:32.499675 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:19:32.499644 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:19:41.113328 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:19:41.113296 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:19:41.117043 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:19:41.117021 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:19:41.118142 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:19:41.118114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:19:41.121623 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:19:41.121603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:20:15.209764 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:15.207278 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:20:30.003019 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:30.002985 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:20:54.919249 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.919213 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt"] Jul 22 02:20:54.919868 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.919708 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af7f5698-0a40-4323-b782-85e1f85634de" containerName="revoke-keys" Jul 22 02:20:54.919868 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.919727 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="af7f5698-0a40-4323-b782-85e1f85634de" containerName="revoke-keys" Jul 22 02:20:54.919995 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.919872 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="af7f5698-0a40-4323-b782-85e1f85634de" containerName="revoke-keys" Jul 22 02:20:54.922953 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.922932 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" Jul 22 02:20:54.925468 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.925452 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:20:54.925468 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.925461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qmc8m\"" Jul 22 02:20:54.931432 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:54.931408 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt"] Jul 22 02:20:55.060003 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:55.059962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd23e134-d58b-4ea9-95d6-c7e1286c2909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt\" (UID: \"cd23e134-d58b-4ea9-95d6-c7e1286c2909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" Jul 22 02:20:55.161382 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:55.161352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd23e134-d58b-4ea9-95d6-c7e1286c2909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt\" (UID: \"cd23e134-d58b-4ea9-95d6-c7e1286c2909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" Jul 22 02:20:55.161988 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:55.161967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd23e134-d58b-4ea9-95d6-c7e1286c2909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt\" (UID: \"cd23e134-d58b-4ea9-95d6-c7e1286c2909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" Jul 22 02:20:55.233875 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:55.233790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" Jul 22 02:20:55.574155 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:55.574118 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt"] Jul 22 02:20:55.576171 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:20:55.576143 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd23e134_d58b_4ea9_95d6_c7e1286c2909.slice/crio-aaecb893cc3727e7609fb5c92a61d50372fa9702f267ec305d2b5da8ebacd38d WatchSource:0}: Error finding container aaecb893cc3727e7609fb5c92a61d50372fa9702f267ec305d2b5da8ebacd38d: Status 404 returned error can't find the container with id aaecb893cc3727e7609fb5c92a61d50372fa9702f267ec305d2b5da8ebacd38d Jul 22 02:20:56.161815 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:56.161777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" event={"ID":"cd23e134-d58b-4ea9-95d6-c7e1286c2909","Type":"ContainerStarted","Data":"d84cd97264a11bf677fb776e4becf66bb62e7f0ff57c291bc9a717ff85af194a"} Jul 22 02:20:56.162207 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:56.161831 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" event={"ID":"cd23e134-d58b-4ea9-95d6-c7e1286c2909","Type":"ContainerStarted","Data":"aaecb893cc3727e7609fb5c92a61d50372fa9702f267ec305d2b5da8ebacd38d"} Jul 22 02:20:56.185700 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:56.185637 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" podStartSLOduration=2.185620868 podStartE2EDuration="2.185620868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:20:56.183431284 +0000 UTC m=+2175.734644997" watchObservedRunningTime="2026-07-22 02:20:56.185620868 +0000 UTC m=+2175.736834580" Jul 22 02:20:57.175629 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:57.175593 2579 generic.go:356] "Generic (PLEG): container finished" podID="cd23e134-d58b-4ea9-95d6-c7e1286c2909" containerID="d84cd97264a11bf677fb776e4becf66bb62e7f0ff57c291bc9a717ff85af194a" exitCode=0 Jul 22 02:20:57.176094 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:57.175672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" event={"ID":"cd23e134-d58b-4ea9-95d6-c7e1286c2909","Type":"ContainerDied","Data":"d84cd97264a11bf677fb776e4becf66bb62e7f0ff57c291bc9a717ff85af194a"} Jul 22 02:20:58.312311 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:58.312290 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" Jul 22 02:20:58.387036 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:58.386998 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd23e134-d58b-4ea9-95d6-c7e1286c2909-maas-api-service-ca\") pod \"cd23e134-d58b-4ea9-95d6-c7e1286c2909\" (UID: \"cd23e134-d58b-4ea9-95d6-c7e1286c2909\") " Jul 22 02:20:58.387347 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:58.387322 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd23e134-d58b-4ea9-95d6-c7e1286c2909-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cd23e134-d58b-4ea9-95d6-c7e1286c2909" (UID: "cd23e134-d58b-4ea9-95d6-c7e1286c2909"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:20:58.487816 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:58.487730 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd23e134-d58b-4ea9-95d6-c7e1286c2909-maas-api-service-ca\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:20:58.504506 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:58.504482 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:20:59.188384 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:59.188355 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" Jul 22 02:20:59.188384 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:59.188378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt" event={"ID":"cd23e134-d58b-4ea9-95d6-c7e1286c2909","Type":"ContainerDied","Data":"aaecb893cc3727e7609fb5c92a61d50372fa9702f267ec305d2b5da8ebacd38d"} Jul 22 02:20:59.188600 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:20:59.188427 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aaecb893cc3727e7609fb5c92a61d50372fa9702f267ec305d2b5da8ebacd38d" Jul 22 02:21:10.025689 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:21:10.025650 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt"] Jul 22 02:21:10.027830 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:21:10.027805 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5f059e-rwrlt"] Jul 22 02:21:10.976348 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:21:10.976313 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd23e134-d58b-4ea9-95d6-c7e1286c2909" path="/var/lib/kubelet/pods/cd23e134-d58b-4ea9-95d6-c7e1286c2909/volumes" Jul 22 02:21:14.995599 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:21:14.995574 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:21:30.498403 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:21:30.498366 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:21:46.107299 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:21:46.107261 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:21:58.408230 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:21:58.408195 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:22:25.204121 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:22:25.204043 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:22:51.100255 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:22:51.100223 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:23:08.701326 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:23:08.701295 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:23:20.898991 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:23:20.898955 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:23:31.918413 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:23:31.918381 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:23:41.164378 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:23:41.164310 2579 scope.go:117] "RemoveContainer" containerID="4989f4c08251a97d7e8e40a43d151d066215dae8f824efdffda2380c6d577b68" Jul 22 02:24:04.793986 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:04.793953 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:24:18.898069 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:18.898039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:24:30.398155 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:30.398124 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:24:41.150503 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:41.150476 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:24:41.154591 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:41.154571 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:24:41.155522 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:41.155502 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:24:41.159543 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:41.159521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:24:48.707401 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:24:48.707364 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:25:06.404417 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:25:06.404375 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:25:23.102523 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:25:23.102485 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:25:41.019516 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:25:41.019480 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:26:00.419502 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:00.419462 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:26:16.756249 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.756207 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt"] Jul 22 02:26:16.756840 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.756698 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd23e134-d58b-4ea9-95d6-c7e1286c2909" containerName="revoke-keys" Jul 22 02:26:16.756840 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.756718 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd23e134-d58b-4ea9-95d6-c7e1286c2909" containerName="revoke-keys" Jul 22 02:26:16.756840 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.756819 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd23e134-d58b-4ea9-95d6-c7e1286c2909" containerName="revoke-keys" Jul 22 02:26:16.760001 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.759983 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.764256 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.764216 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-000830\"/\"kube-root-ca.crt\"" Jul 22 02:26:16.764256 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.764244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-000830\"/\"sub-test-model-000830-kserve-self-signed-certs\"" Jul 22 02:26:16.764459 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.764275 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-000830\"/\"openshift-service-ca.crt\"" Jul 22 02:26:16.764459 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.764280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-000830\"/\"default-dockercfg-8jfbh\"" Jul 22 02:26:16.784139 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.784104 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt"] Jul 22 02:26:16.791019 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.790982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tmp-dir\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.791192 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.791031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tls-certs\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.791192 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.791086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-model-cache\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.791192 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.791103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pcfp\" (UniqueName: \"kubernetes.io/projected/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-kube-api-access-2pcfp\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.791321 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.791212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-dshm\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.791321 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.791251 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-home\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892205 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tmp-dir\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892383 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tls-certs\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892383 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-model-cache\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892472 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pcfp\" (UniqueName: \"kubernetes.io/projected/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-kube-api-access-2pcfp\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892542 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-dshm\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892592 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-home\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892689 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892653 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tmp-dir\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892689 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892692 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-model-cache\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.892895 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.892846 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-home\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.894598 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.894571 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-dshm\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.894757 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.894727 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tls-certs\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:16.903030 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:16.902986 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pcfp\" (UniqueName: \"kubernetes.io/projected/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-kube-api-access-2pcfp\") pod \"sub-test-model-000830-kserve-77655f46d5-kjqlt\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:17.070084 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:17.069972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:17.225205 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:17.225179 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt"] Jul 22 02:26:17.227368 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:26:17.227336 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a1a6e91_8fbf_4b5f_a143_ed7aebc288f3.slice/crio-4f7ce334b3b6ad74f00ad5cef7f11681513a3489b920ac7c9a637b8f431f8283 WatchSource:0}: Error finding container 4f7ce334b3b6ad74f00ad5cef7f11681513a3489b920ac7c9a637b8f431f8283: Status 404 returned error can't find the container with id 4f7ce334b3b6ad74f00ad5cef7f11681513a3489b920ac7c9a637b8f431f8283 Jul 22 02:26:17.239226 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:17.239196 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:26:17.854925 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:17.854882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" event={"ID":"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3","Type":"ContainerStarted","Data":"dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a"} Jul 22 02:26:17.854925 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:17.854926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" event={"ID":"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3","Type":"ContainerStarted","Data":"4f7ce334b3b6ad74f00ad5cef7f11681513a3489b920ac7c9a637b8f431f8283"} Jul 22 02:26:17.874688 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:17.874626 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" podStartSLOduration=1.874612127 podStartE2EDuration="1.874612127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:17.874334756 +0000 UTC m=+2497.425548468" watchObservedRunningTime="2026-07-22 02:26:17.874612127 +0000 UTC m=+2497.425825840" Jul 22 02:26:26.796003 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:26.795967 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:26:27.070203 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:27.070095 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:27.070203 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:27.070161 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:27.082842 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:27.082815 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:27.918988 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:27.918960 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:26:44.200659 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:44.200570 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:26:58.898613 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:26:58.898576 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:27:18.499370 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:18.499329 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:27:25.336872 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:25.336836 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt"] Jul 22 02:27:36.318040 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:36.318006 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:27:40.356832 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.356789 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" podUID="0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" containerName="main" containerID="cri-o://dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a" gracePeriod=45 Jul 22 02:27:40.613058 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.612985 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:27:40.697598 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.697567 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pcfp\" (UniqueName: \"kubernetes.io/projected/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-kube-api-access-2pcfp\") pod \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " Jul 22 02:27:40.697790 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.697606 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-home\") pod \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " Jul 22 02:27:40.697790 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.697631 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-dshm\") pod \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " Jul 22 02:27:40.697790 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.697658 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tls-certs\") pod \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " Jul 22 02:27:40.697790 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.697692 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-model-cache\") pod \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " Jul 22 02:27:40.697790 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.697716 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tmp-dir\") pod \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\" (UID: \"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3\") " Jul 22 02:27:40.698066 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.697881 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-home" (OuterVolumeSpecName: "home") pod "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" (UID: "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:27:40.698066 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.698004 2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-home\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:27:40.698066 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.698025 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" (UID: "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:27:40.698180 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.698066 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" (UID: "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:27:40.699916 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.699887 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" (UID: "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:27:40.699916 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.699903 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-dshm" (OuterVolumeSpecName: "dshm") pod "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" (UID: "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:27:40.700024 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.699952 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-kube-api-access-2pcfp" (OuterVolumeSpecName: "kube-api-access-2pcfp") pod "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" (UID: "0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3"). InnerVolumeSpecName "kube-api-access-2pcfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:27:40.799442 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.799393 2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-model-cache\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:27:40.799657 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.799461 2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tmp-dir\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:27:40.799657 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.799475 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pcfp\" (UniqueName: \"kubernetes.io/projected/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-kube-api-access-2pcfp\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:27:40.799657 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.799486 2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-dshm\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:27:40.799657 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:40.799497 2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3-tls-certs\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:27:41.208234 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.208202 2579 scope.go:117] "RemoveContainer" containerID="d84cd97264a11bf677fb776e4becf66bb62e7f0ff57c291bc9a717ff85af194a" Jul 22 02:27:41.298461 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.298381 2579 generic.go:356] "Generic (PLEG): container finished" podID="0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" containerID="dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a" exitCode=0 Jul 22 02:27:41.298461 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.298428 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" Jul 22 02:27:41.298662 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.298462 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" event={"ID":"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3","Type":"ContainerDied","Data":"dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a"} Jul 22 02:27:41.298662 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.298512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt" event={"ID":"0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3","Type":"ContainerDied","Data":"4f7ce334b3b6ad74f00ad5cef7f11681513a3489b920ac7c9a637b8f431f8283"} Jul 22 02:27:41.298662 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.298537 2579 scope.go:117] "RemoveContainer" containerID="dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a" Jul 22 02:27:41.307091 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.307076 2579 scope.go:117] "RemoveContainer" containerID="dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a" Jul 22 02:27:41.307330 ip-10-0-141-12 kubenswrapper[2579]: E0722 02:27:41.307308 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a\": container with ID starting with dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a not found: ID does not exist" containerID="dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a" Jul 22 02:27:41.307374 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.307338 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a"} err="failed to get container status \"dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a\": rpc error: code = NotFound desc = could not find container \"dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a\": container with ID starting with dec921758e323d21315758e5917b2de32e12f9a6f52bbbdddcc6718a8f148a4a not found: ID does not exist" Jul 22 02:27:41.328134 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.328104 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt"] Jul 22 02:27:41.344552 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:41.344525 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-000830/sub-test-model-000830-kserve-77655f46d5-kjqlt"] Jul 22 02:27:42.971779 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:42.971733 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" path="/var/lib/kubelet/pods/0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3/volumes" Jul 22 02:27:46.127855 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:27:46.127822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:28:09.426851 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:28:09.426770 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:28:36.879989 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:28:36.879953 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:28:52.203754 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:28:52.203717 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:29:01.393649 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.393612 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7506-139998771019056"] Jul 22 02:29:01.394040 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.393965 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" containerName="main" Jul 22 02:29:01.394040 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.393976 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" containerName="main" Jul 22 02:29:01.394112 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.394046 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a1a6e91-8fbf-4b5f-a143-ed7aebc288f3" containerName="main" Jul 22 02:29:01.397160 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.397143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:01.399184 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.399161 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hwnhc\"" Jul 22 02:29:01.403607 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.403583 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998771019056"] Jul 22 02:29:01.475209 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.475178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mlt2\" (UniqueName: \"kubernetes.io/projected/866daa5a-1a81-476a-ba62-f813ca6561e2-kube-api-access-8mlt2\") pod \"test-curl-7506-139998771019056\" (UID: \"866daa5a-1a81-476a-ba62-f813ca6561e2\") " pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:01.575879 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.575848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mlt2\" (UniqueName: \"kubernetes.io/projected/866daa5a-1a81-476a-ba62-f813ca6561e2-kube-api-access-8mlt2\") pod \"test-curl-7506-139998771019056\" (UID: \"866daa5a-1a81-476a-ba62-f813ca6561e2\") " pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:01.583337 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.583315 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mlt2\" (UniqueName: \"kubernetes.io/projected/866daa5a-1a81-476a-ba62-f813ca6561e2-kube-api-access-8mlt2\") pod \"test-curl-7506-139998771019056\" (UID: \"866daa5a-1a81-476a-ba62-f813ca6561e2\") " pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:01.707851 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.707789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:01.836650 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.836629 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998771019056"] Jul 22 02:29:01.838380 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:29:01.838358 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod866daa5a_1a81_476a_ba62_f813ca6561e2.slice/crio-13126c45c34354238a84fa1c4248b8fe55ffdfd405de0f50008dac69ed8f6e12 WatchSource:0}: Error finding container 13126c45c34354238a84fa1c4248b8fe55ffdfd405de0f50008dac69ed8f6e12: Status 404 returned error can't find the container with id 13126c45c34354238a84fa1c4248b8fe55ffdfd405de0f50008dac69ed8f6e12 Jul 22 02:29:01.839673 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:01.839653 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:29:02.714206 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:02.714169 2579 generic.go:356] "Generic (PLEG): container finished" podID="866daa5a-1a81-476a-ba62-f813ca6561e2" containerID="33b35d8abf360f845068b613455f4b3553a848c07c17ec886bc9cd3d2c3fe0c6" exitCode=0 Jul 22 02:29:02.714495 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:02.714245 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998771019056" event={"ID":"866daa5a-1a81-476a-ba62-f813ca6561e2","Type":"ContainerDied","Data":"33b35d8abf360f845068b613455f4b3553a848c07c17ec886bc9cd3d2c3fe0c6"} Jul 22 02:29:02.714495 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:02.714271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998771019056" event={"ID":"866daa5a-1a81-476a-ba62-f813ca6561e2","Type":"ContainerStarted","Data":"13126c45c34354238a84fa1c4248b8fe55ffdfd405de0f50008dac69ed8f6e12"} Jul 22 02:29:03.842166 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:03.842145 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:03.889083 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:03.889060 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mlt2\" (UniqueName: \"kubernetes.io/projected/866daa5a-1a81-476a-ba62-f813ca6561e2-kube-api-access-8mlt2\") pod \"866daa5a-1a81-476a-ba62-f813ca6561e2\" (UID: \"866daa5a-1a81-476a-ba62-f813ca6561e2\") " Jul 22 02:29:03.891129 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:03.891105 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866daa5a-1a81-476a-ba62-f813ca6561e2-kube-api-access-8mlt2" (OuterVolumeSpecName: "kube-api-access-8mlt2") pod "866daa5a-1a81-476a-ba62-f813ca6561e2" (UID: "866daa5a-1a81-476a-ba62-f813ca6561e2"). InnerVolumeSpecName "kube-api-access-8mlt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:29:03.891886 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:03.891864 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7506-139998771019056_866daa5a-1a81-476a-ba62-f813ca6561e2/test-curl-7506-139998771019056/0.log" Jul 22 02:29:03.920041 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:03.920019 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7506-139998771019056"] Jul 22 02:29:03.924466 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:03.924447 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7506-139998771019056"] Jul 22 02:29:03.990082 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:03.990026 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mlt2\" (UniqueName: \"kubernetes.io/projected/866daa5a-1a81-476a-ba62-f813ca6561e2-kube-api-access-8mlt2\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:29:04.054517 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.054490 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7506-139998771019568"] Jul 22 02:29:04.054832 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.054817 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866daa5a-1a81-476a-ba62-f813ca6561e2" containerName="test-curl-7506-139998771019056" Jul 22 02:29:04.054888 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.054833 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="866daa5a-1a81-476a-ba62-f813ca6561e2" containerName="test-curl-7506-139998771019056" Jul 22 02:29:04.054935 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.054902 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="866daa5a-1a81-476a-ba62-f813ca6561e2" containerName="test-curl-7506-139998771019056" Jul 22 02:29:04.057869 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.057854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019568" Jul 22 02:29:04.068876 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.068853 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998771019568"] Jul 22 02:29:04.091041 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.091004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2zkd\" (UniqueName: \"kubernetes.io/projected/484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa-kube-api-access-q2zkd\") pod \"test-curl-7506-139998771019568\" (UID: \"484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa\") " pod="opendatahub/test-curl-7506-139998771019568" Jul 22 02:29:04.191688 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.191649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zkd\" (UniqueName: \"kubernetes.io/projected/484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa-kube-api-access-q2zkd\") pod \"test-curl-7506-139998771019568\" (UID: \"484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa\") " pod="opendatahub/test-curl-7506-139998771019568" Jul 22 02:29:04.199929 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.199905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2zkd\" (UniqueName: \"kubernetes.io/projected/484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa-kube-api-access-q2zkd\") pod \"test-curl-7506-139998771019568\" (UID: \"484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa\") " pod="opendatahub/test-curl-7506-139998771019568" Jul 22 02:29:04.366689 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.366667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019568" Jul 22 02:29:04.492917 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.492894 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998771019568"] Jul 22 02:29:04.494369 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:29:04.494343 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod484ba3c0_cf3e_4ce9_99ff_12fb65ff2cfa.slice/crio-c6ebdd76efd6952279483c596edff154aa43cd3883241ee5ce1ce76589492b33 WatchSource:0}: Error finding container c6ebdd76efd6952279483c596edff154aa43cd3883241ee5ce1ce76589492b33: Status 404 returned error can't find the container with id c6ebdd76efd6952279483c596edff154aa43cd3883241ee5ce1ce76589492b33 Jul 22 02:29:04.726175 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.726105 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13126c45c34354238a84fa1c4248b8fe55ffdfd405de0f50008dac69ed8f6e12" Jul 22 02:29:04.726175 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.726129 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:04.727310 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.727285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998771019568" event={"ID":"484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa","Type":"ContainerStarted","Data":"c6ebdd76efd6952279483c596edff154aa43cd3883241ee5ce1ce76589492b33"} Jul 22 02:29:04.735957 ip-10-0-141-12 kubenswrapper[2579]: E0722 02:29:04.735934 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7506-139998771019056\" is forbidden: User \"system:node:ip-10-0-141-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-12.ec2.internal' and this object" podUID="866daa5a-1a81-476a-ba62-f813ca6561e2" pod="opendatahub/test-curl-7506-139998771019056" Jul 22 02:29:04.971398 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:04.971367 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866daa5a-1a81-476a-ba62-f813ca6561e2" path="/var/lib/kubelet/pods/866daa5a-1a81-476a-ba62-f813ca6561e2/volumes" Jul 22 02:29:05.734344 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:05.734311 2579 generic.go:356] "Generic (PLEG): container finished" podID="484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa" containerID="58cc4b9201ae9ef37ec1dc62e187412659fb20df1adb315c033ebe00f727f33f" exitCode=0 Jul 22 02:29:05.734482 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:05.734382 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998771019568" event={"ID":"484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa","Type":"ContainerDied","Data":"58cc4b9201ae9ef37ec1dc62e187412659fb20df1adb315c033ebe00f727f33f"} Jul 22 02:29:06.869481 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:06.869457 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019568" Jul 22 02:29:06.891905 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:06.891880 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7506-139998771019568_484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa/test-curl-7506-139998771019568/0.log" Jul 22 02:29:06.910720 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:06.910697 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2zkd\" (UniqueName: \"kubernetes.io/projected/484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa-kube-api-access-q2zkd\") pod \"484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa\" (UID: \"484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa\") " Jul 22 02:29:06.912767 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:06.912717 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa-kube-api-access-q2zkd" (OuterVolumeSpecName: "kube-api-access-q2zkd") pod "484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa" (UID: "484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa"). InnerVolumeSpecName "kube-api-access-q2zkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:29:06.916183 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:06.916158 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7506-139998771019568"] Jul 22 02:29:06.922432 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:06.922406 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7506-139998771019568"] Jul 22 02:29:06.970923 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:06.970895 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa" path="/var/lib/kubelet/pods/484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa/volumes" Jul 22 02:29:07.012139 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.012059 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2zkd\" (UniqueName: \"kubernetes.io/projected/484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa-kube-api-access-q2zkd\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:29:07.086626 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.086589 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:07.087019 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.086994 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa" containerName="test-curl-7506-139998771019568" Jul 22 02:29:07.087112 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.087021 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa" containerName="test-curl-7506-139998771019568" Jul 22 02:29:07.087164 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.087144 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="484ba3c0-cf3e-4ce9-99ff-12fb65ff2cfa" containerName="test-curl-7506-139998771019568" Jul 22 02:29:07.090161 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.090142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:07.098117 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.098094 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:07.112662 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.112630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zsw\" (UniqueName: \"kubernetes.io/projected/17cec0d9-9b13-424b-a240-cd5e4417210a-kube-api-access-g5zsw\") pod \"test-curl-7506-139998770983968\" (UID: \"17cec0d9-9b13-424b-a240-cd5e4417210a\") " pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:07.213256 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.213219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zsw\" (UniqueName: \"kubernetes.io/projected/17cec0d9-9b13-424b-a240-cd5e4417210a-kube-api-access-g5zsw\") pod \"test-curl-7506-139998770983968\" (UID: \"17cec0d9-9b13-424b-a240-cd5e4417210a\") " pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:07.222598 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.222566 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zsw\" (UniqueName: \"kubernetes.io/projected/17cec0d9-9b13-424b-a240-cd5e4417210a-kube-api-access-g5zsw\") pod \"test-curl-7506-139998770983968\" (UID: \"17cec0d9-9b13-424b-a240-cd5e4417210a\") " pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:07.399479 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.399440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:07.533654 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.533625 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:07.536004 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:29:07.535976 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17cec0d9_9b13_424b_a240_cd5e4417210a.slice/crio-22b4834d3bc5844fc1328ad9ffad84bbb889612b57a798f71c0d264ee224aecb WatchSource:0}: Error finding container 22b4834d3bc5844fc1328ad9ffad84bbb889612b57a798f71c0d264ee224aecb: Status 404 returned error can't find the container with id 22b4834d3bc5844fc1328ad9ffad84bbb889612b57a798f71c0d264ee224aecb Jul 22 02:29:07.745500 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.745414 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998771019568" Jul 22 02:29:07.745500 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.745428 2579 scope.go:117] "RemoveContainer" containerID="58cc4b9201ae9ef37ec1dc62e187412659fb20df1adb315c033ebe00f727f33f" Jul 22 02:29:07.746844 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:07.746630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770983968" event={"ID":"17cec0d9-9b13-424b-a240-cd5e4417210a","Type":"ContainerStarted","Data":"22b4834d3bc5844fc1328ad9ffad84bbb889612b57a798f71c0d264ee224aecb"} Jul 22 02:29:08.754816 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:08.754773 2579 generic.go:356] "Generic (PLEG): container finished" podID="17cec0d9-9b13-424b-a240-cd5e4417210a" containerID="9d85f3e04f22514cdab54fc8a81860d48d492708dc1c21cd51c7da09617f0441" exitCode=0 Jul 22 02:29:08.755307 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:08.754883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770983968" event={"ID":"17cec0d9-9b13-424b-a240-cd5e4417210a","Type":"ContainerDied","Data":"9d85f3e04f22514cdab54fc8a81860d48d492708dc1c21cd51c7da09617f0441"} Jul 22 02:29:09.888595 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:09.888571 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:09.917868 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:09.917839 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7506-139998770983968_17cec0d9-9b13-424b-a240-cd5e4417210a/test-curl-7506-139998770983968/0.log" Jul 22 02:29:09.934046 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:09.934020 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5zsw\" (UniqueName: \"kubernetes.io/projected/17cec0d9-9b13-424b-a240-cd5e4417210a-kube-api-access-g5zsw\") pod \"17cec0d9-9b13-424b-a240-cd5e4417210a\" (UID: \"17cec0d9-9b13-424b-a240-cd5e4417210a\") " Jul 22 02:29:09.936184 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:09.936161 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17cec0d9-9b13-424b-a240-cd5e4417210a-kube-api-access-g5zsw" (OuterVolumeSpecName: "kube-api-access-g5zsw") pod "17cec0d9-9b13-424b-a240-cd5e4417210a" (UID: "17cec0d9-9b13-424b-a240-cd5e4417210a"). InnerVolumeSpecName "kube-api-access-g5zsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:29:09.947905 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:09.947883 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:09.951860 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:09.951840 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:10.035189 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.035107 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5zsw\" (UniqueName: \"kubernetes.io/projected/17cec0d9-9b13-424b-a240-cd5e4417210a-kube-api-access-g5zsw\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:29:10.086056 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.086021 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:10.086394 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.086381 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17cec0d9-9b13-424b-a240-cd5e4417210a" containerName="test-curl-7506-139998770983968" Jul 22 02:29:10.086437 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.086395 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="17cec0d9-9b13-424b-a240-cd5e4417210a" containerName="test-curl-7506-139998770983968" Jul 22 02:29:10.086484 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.086475 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="17cec0d9-9b13-424b-a240-cd5e4417210a" containerName="test-curl-7506-139998770983968" Jul 22 02:29:10.089493 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.089478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:10.099251 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.099226 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:10.135883 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.135843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwnvw\" (UniqueName: \"kubernetes.io/projected/a231f1c3-33e1-49cc-9d45-19302a9a9354-kube-api-access-wwnvw\") pod \"test-curl-7506-139998770983968\" (UID: \"a231f1c3-33e1-49cc-9d45-19302a9a9354\") " pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:10.237275 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.237220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwnvw\" (UniqueName: \"kubernetes.io/projected/a231f1c3-33e1-49cc-9d45-19302a9a9354-kube-api-access-wwnvw\") pod \"test-curl-7506-139998770983968\" (UID: \"a231f1c3-33e1-49cc-9d45-19302a9a9354\") " pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:10.246703 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.246679 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwnvw\" (UniqueName: \"kubernetes.io/projected/a231f1c3-33e1-49cc-9d45-19302a9a9354-kube-api-access-wwnvw\") pod \"test-curl-7506-139998770983968\" (UID: \"a231f1c3-33e1-49cc-9d45-19302a9a9354\") " pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:10.398497 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.398467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:10.529788 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.529766 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:10.532203 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:29:10.532173 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda231f1c3_33e1_49cc_9d45_19302a9a9354.slice/crio-8fe979e98b412d54352c097810a7dc2a043201d8cbbe3064611274693348199c WatchSource:0}: Error finding container 8fe979e98b412d54352c097810a7dc2a043201d8cbbe3064611274693348199c: Status 404 returned error can't find the container with id 8fe979e98b412d54352c097810a7dc2a043201d8cbbe3064611274693348199c Jul 22 02:29:10.767293 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.767209 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:10.767293 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.767237 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22b4834d3bc5844fc1328ad9ffad84bbb889612b57a798f71c0d264ee224aecb" Jul 22 02:29:10.768389 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.768357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770983968" event={"ID":"a231f1c3-33e1-49cc-9d45-19302a9a9354","Type":"ContainerStarted","Data":"8fe979e98b412d54352c097810a7dc2a043201d8cbbe3064611274693348199c"} Jul 22 02:29:10.779068 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.779040 2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7506-139998770983968" oldPodUID="17cec0d9-9b13-424b-a240-cd5e4417210a" podUID="a231f1c3-33e1-49cc-9d45-19302a9a9354" Jul 22 02:29:10.971090 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:10.971063 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17cec0d9-9b13-424b-a240-cd5e4417210a" path="/var/lib/kubelet/pods/17cec0d9-9b13-424b-a240-cd5e4417210a/volumes" Jul 22 02:29:11.775401 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:11.775369 2579 generic.go:356] "Generic (PLEG): container finished" podID="a231f1c3-33e1-49cc-9d45-19302a9a9354" containerID="40b745d05e81ea8d8148ffe711296d4601e70f774d9e2d419038aff31dd94ece" exitCode=0 Jul 22 02:29:11.775595 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:11.775430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770983968" event={"ID":"a231f1c3-33e1-49cc-9d45-19302a9a9354","Type":"ContainerDied","Data":"40b745d05e81ea8d8148ffe711296d4601e70f774d9e2d419038aff31dd94ece"} Jul 22 02:29:12.105775 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.105727 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:29:12.912992 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.912963 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:12.933088 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.933062 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7506-139998770983968_a231f1c3-33e1-49cc-9d45-19302a9a9354/test-curl-7506-139998770983968/0.log" Jul 22 02:29:12.959337 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.959302 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:12.960282 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.960264 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwnvw\" (UniqueName: \"kubernetes.io/projected/a231f1c3-33e1-49cc-9d45-19302a9a9354-kube-api-access-wwnvw\") pod \"a231f1c3-33e1-49cc-9d45-19302a9a9354\" (UID: \"a231f1c3-33e1-49cc-9d45-19302a9a9354\") " Jul 22 02:29:12.962792 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.962761 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a231f1c3-33e1-49cc-9d45-19302a9a9354-kube-api-access-wwnvw" (OuterVolumeSpecName: "kube-api-access-wwnvw") pod "a231f1c3-33e1-49cc-9d45-19302a9a9354" (UID: "a231f1c3-33e1-49cc-9d45-19302a9a9354"). InnerVolumeSpecName "kube-api-access-wwnvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:29:12.963208 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.963187 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7506-139998770983968"] Jul 22 02:29:12.972106 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:12.972075 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a231f1c3-33e1-49cc-9d45-19302a9a9354" path="/var/lib/kubelet/pods/a231f1c3-33e1-49cc-9d45-19302a9a9354/volumes" Jul 22 02:29:13.061925 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.061830 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwnvw\" (UniqueName: \"kubernetes.io/projected/a231f1c3-33e1-49cc-9d45-19302a9a9354-kube-api-access-wwnvw\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:29:13.092377 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.092341 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:13.092727 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.092712 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a231f1c3-33e1-49cc-9d45-19302a9a9354" containerName="test-curl-7506-139998770983968" Jul 22 02:29:13.092806 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.092728 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a231f1c3-33e1-49cc-9d45-19302a9a9354" containerName="test-curl-7506-139998770983968" Jul 22 02:29:13.092806 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.092801 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a231f1c3-33e1-49cc-9d45-19302a9a9354" containerName="test-curl-7506-139998770983968" Jul 22 02:29:13.095867 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.095850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:13.100839 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.100814 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:13.162182 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.162145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9rwq\" (UniqueName: \"kubernetes.io/projected/cdeac66d-7509-438b-a732-3300af691ae4-kube-api-access-z9rwq\") pod \"test-curl-7506-139998770984976\" (UID: \"cdeac66d-7509-438b-a732-3300af691ae4\") " pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:13.263073 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.263030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9rwq\" (UniqueName: \"kubernetes.io/projected/cdeac66d-7509-438b-a732-3300af691ae4-kube-api-access-z9rwq\") pod \"test-curl-7506-139998770984976\" (UID: \"cdeac66d-7509-438b-a732-3300af691ae4\") " pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:13.271141 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.271112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9rwq\" (UniqueName: \"kubernetes.io/projected/cdeac66d-7509-438b-a732-3300af691ae4-kube-api-access-z9rwq\") pod \"test-curl-7506-139998770984976\" (UID: \"cdeac66d-7509-438b-a732-3300af691ae4\") " pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:13.405639 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.405599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:13.539907 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.539876 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:13.542466 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:29:13.542442 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdeac66d_7509_438b_a732_3300af691ae4.slice/crio-bdc7614dc322638e78e565e7e8635a5ea56a1b9ffb77fd6af3512adbbe237f02 WatchSource:0}: Error finding container bdc7614dc322638e78e565e7e8635a5ea56a1b9ffb77fd6af3512adbbe237f02: Status 404 returned error can't find the container with id bdc7614dc322638e78e565e7e8635a5ea56a1b9ffb77fd6af3512adbbe237f02 Jul 22 02:29:13.787808 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.787702 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770984976" event={"ID":"cdeac66d-7509-438b-a732-3300af691ae4","Type":"ContainerStarted","Data":"bdc7614dc322638e78e565e7e8635a5ea56a1b9ffb77fd6af3512adbbe237f02"} Jul 22 02:29:13.788921 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.788904 2579 scope.go:117] "RemoveContainer" containerID="40b745d05e81ea8d8148ffe711296d4601e70f774d9e2d419038aff31dd94ece" Jul 22 02:29:13.789040 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:13.788905 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770983968" Jul 22 02:29:14.796918 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:14.796883 2579 generic.go:356] "Generic (PLEG): container finished" podID="cdeac66d-7509-438b-a732-3300af691ae4" containerID="06b3fb3afabd8f6704689f57f83796afacccce1f0a6838033581d46eb2526d84" exitCode=0 Jul 22 02:29:14.797301 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:14.796943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770984976" event={"ID":"cdeac66d-7509-438b-a732-3300af691ae4","Type":"ContainerDied","Data":"06b3fb3afabd8f6704689f57f83796afacccce1f0a6838033581d46eb2526d84"} Jul 22 02:29:15.935229 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:15.935207 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:15.954329 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:15.954308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7506-139998770984976_cdeac66d-7509-438b-a732-3300af691ae4/test-curl-7506-139998770984976/0.log" Jul 22 02:29:15.979035 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:15.979003 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:15.982003 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:15.981981 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9rwq\" (UniqueName: \"kubernetes.io/projected/cdeac66d-7509-438b-a732-3300af691ae4-kube-api-access-z9rwq\") pod \"cdeac66d-7509-438b-a732-3300af691ae4\" (UID: \"cdeac66d-7509-438b-a732-3300af691ae4\") " Jul 22 02:29:15.984123 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:15.984101 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdeac66d-7509-438b-a732-3300af691ae4-kube-api-access-z9rwq" (OuterVolumeSpecName: "kube-api-access-z9rwq") pod "cdeac66d-7509-438b-a732-3300af691ae4" (UID: "cdeac66d-7509-438b-a732-3300af691ae4"). InnerVolumeSpecName "kube-api-access-z9rwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:29:15.984541 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:15.984521 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:16.082653 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.082585 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9rwq\" (UniqueName: \"kubernetes.io/projected/cdeac66d-7509-438b-a732-3300af691ae4-kube-api-access-z9rwq\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:29:16.121062 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.121036 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:16.121363 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.121350 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdeac66d-7509-438b-a732-3300af691ae4" containerName="test-curl-7506-139998770984976" Jul 22 02:29:16.121408 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.121365 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdeac66d-7509-438b-a732-3300af691ae4" containerName="test-curl-7506-139998770984976" Jul 22 02:29:16.121443 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.121424 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdeac66d-7509-438b-a732-3300af691ae4" containerName="test-curl-7506-139998770984976" Jul 22 02:29:16.124325 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.124311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:16.130925 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.130902 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:16.183901 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.183870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkn5p\" (UniqueName: \"kubernetes.io/projected/75a5ebb1-80fa-4aaf-ad61-306c046f9141-kube-api-access-dkn5p\") pod \"test-curl-7506-139998770984976\" (UID: \"75a5ebb1-80fa-4aaf-ad61-306c046f9141\") " pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:16.284925 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.284896 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkn5p\" (UniqueName: \"kubernetes.io/projected/75a5ebb1-80fa-4aaf-ad61-306c046f9141-kube-api-access-dkn5p\") pod \"test-curl-7506-139998770984976\" (UID: \"75a5ebb1-80fa-4aaf-ad61-306c046f9141\") " pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:16.293036 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.293007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkn5p\" (UniqueName: \"kubernetes.io/projected/75a5ebb1-80fa-4aaf-ad61-306c046f9141-kube-api-access-dkn5p\") pod \"test-curl-7506-139998770984976\" (UID: \"75a5ebb1-80fa-4aaf-ad61-306c046f9141\") " pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:16.433523 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.433490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:16.563186 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.563160 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:16.565217 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:29:16.565194 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75a5ebb1_80fa_4aaf_ad61_306c046f9141.slice/crio-11a90b1c6502423146267ec00aada90e4820e01ca0ccaa52229c64449573d4e5 WatchSource:0}: Error finding container 11a90b1c6502423146267ec00aada90e4820e01ca0ccaa52229c64449573d4e5: Status 404 returned error can't find the container with id 11a90b1c6502423146267ec00aada90e4820e01ca0ccaa52229c64449573d4e5 Jul 22 02:29:16.808577 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.808493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770984976" event={"ID":"75a5ebb1-80fa-4aaf-ad61-306c046f9141","Type":"ContainerStarted","Data":"11a90b1c6502423146267ec00aada90e4820e01ca0ccaa52229c64449573d4e5"} Jul 22 02:29:16.809600 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.809579 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdc7614dc322638e78e565e7e8635a5ea56a1b9ffb77fd6af3512adbbe237f02" Jul 22 02:29:16.809716 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.809603 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:16.820421 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.820399 2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7506-139998770984976" oldPodUID="cdeac66d-7509-438b-a732-3300af691ae4" podUID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" Jul 22 02:29:16.970646 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:16.970623 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdeac66d-7509-438b-a732-3300af691ae4" path="/var/lib/kubelet/pods/cdeac66d-7509-438b-a732-3300af691ae4/volumes" Jul 22 02:29:17.816704 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:17.816669 2579 generic.go:356] "Generic (PLEG): container finished" podID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" containerID="e4e2100fd2d32aaacc928dc45e3d6db75e3180e29ab543bca1a420a54e4a14ad" exitCode=0 Jul 22 02:29:17.816888 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:17.816730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-139998770984976" event={"ID":"75a5ebb1-80fa-4aaf-ad61-306c046f9141","Type":"ContainerDied","Data":"e4e2100fd2d32aaacc928dc45e3d6db75e3180e29ab543bca1a420a54e4a14ad"} Jul 22 02:29:18.963978 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:18.963954 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:18.986774 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:18.986734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7506-139998770984976_75a5ebb1-80fa-4aaf-ad61-306c046f9141/test-curl-7506-139998770984976/0.log" Jul 22 02:29:19.006996 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:19.006973 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkn5p\" (UniqueName: \"kubernetes.io/projected/75a5ebb1-80fa-4aaf-ad61-306c046f9141-kube-api-access-dkn5p\") pod \"75a5ebb1-80fa-4aaf-ad61-306c046f9141\" (UID: \"75a5ebb1-80fa-4aaf-ad61-306c046f9141\") " Jul 22 02:29:19.009473 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:19.009446 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a5ebb1-80fa-4aaf-ad61-306c046f9141-kube-api-access-dkn5p" (OuterVolumeSpecName: "kube-api-access-dkn5p") pod "75a5ebb1-80fa-4aaf-ad61-306c046f9141" (UID: "75a5ebb1-80fa-4aaf-ad61-306c046f9141"). InnerVolumeSpecName "kube-api-access-dkn5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:29:19.010845 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:19.010825 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:19.014810 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:19.014794 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7506-139998770984976"] Jul 22 02:29:19.108227 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:19.108202 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkn5p\" (UniqueName: \"kubernetes.io/projected/75a5ebb1-80fa-4aaf-ad61-306c046f9141-kube-api-access-dkn5p\") on node \"ip-10-0-141-12.ec2.internal\" DevicePath \"\"" Jul 22 02:29:19.829407 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:19.829378 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:19.829560 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:19.829428 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11a90b1c6502423146267ec00aada90e4820e01ca0ccaa52229c64449573d4e5" Jul 22 02:29:19.839146 ip-10-0-141-12 kubenswrapper[2579]: E0722 02:29:19.839119 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7506-139998770984976\" is forbidden: User \"system:node:ip-10-0-141-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-12.ec2.internal' and this object" podUID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:20.969678 ip-10-0-141-12 kubenswrapper[2579]: E0722 02:29:20.969646 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7506-139998770984976\" is forbidden: User \"system:node:ip-10-0-141-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-12.ec2.internal' and this object" podUID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" pod="opendatahub/test-curl-7506-139998770984976" Jul 22 02:29:20.970419 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:20.970398 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" path="/var/lib/kubelet/pods/75a5ebb1-80fa-4aaf-ad61-306c046f9141/volumes" Jul 22 02:29:32.908363 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:32.908328 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:29:41.185083 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:41.185052 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:29:41.195483 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:41.195456 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:29:41.198053 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:41.198031 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:29:41.201945 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:41.201930 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gzvl_0cd82753-62c6-44a4-a650-55aaf0c4914f/ovn-acl-logging/0.log" Jul 22 02:29:55.107715 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:29:55.107684 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jc4xg"] Jul 22 02:30:03.956054 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:03.956017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5656c7c8-57mgf_35f37ff4-2e7d-4f14-87cd-a586b704fa9c/authorino/0.log" Jul 22 02:30:10.183899 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:10.183864 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rcdpr_fc6c02d4-4189-45ed-b8eb-ced8625af5be/manager/0.log" Jul 22 02:30:10.579873 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:10.579797 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585784b644-n2jf2_d8193bf6-d109-41d5-a13d-42bb1583756a/copy-manifests/0.log" Jul 22 02:30:10.587175 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:10.587150 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585784b644-n2jf2_d8193bf6-d109-41d5-a13d-42bb1583756a/manager/0.log" Jul 22 02:30:11.083830 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:11.083802 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744760-7hcc9_65b729f9-3083-4185-9ff2-341366159f88/cleanup/0.log" Jul 22 02:30:12.291211 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.291184 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w_fc975532-22e2-492e-9c13-176575e4decd/util/0.log" Jul 22 02:30:12.297948 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.297924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w_fc975532-22e2-492e-9c13-176575e4decd/pull/0.log" Jul 22 02:30:12.304723 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.304696 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w_fc975532-22e2-492e-9c13-176575e4decd/extract/0.log" Jul 22 02:30:12.428292 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.428270 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x_6fb73ba1-713d-4ba0-9a33-3315197dcbfa/extract/0.log" Jul 22 02:30:12.434584 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.434565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x_6fb73ba1-713d-4ba0-9a33-3315197dcbfa/util/0.log" Jul 22 02:30:12.441601 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.441584 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x_6fb73ba1-713d-4ba0-9a33-3315197dcbfa/pull/0.log" Jul 22 02:30:12.564852 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.564787 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq_c49fe75a-e876-46a2-9be2-35b2d1f73a26/extract/0.log" Jul 22 02:30:12.571520 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.571492 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq_c49fe75a-e876-46a2-9be2-35b2d1f73a26/util/0.log" Jul 22 02:30:12.579835 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.579815 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq_c49fe75a-e876-46a2-9be2-35b2d1f73a26/pull/0.log" Jul 22 02:30:12.708314 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.708284 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc_dd75a623-9db2-4cc1-9605-ec992241481e/util/0.log" Jul 22 02:30:12.714844 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.714824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc_dd75a623-9db2-4cc1-9605-ec992241481e/pull/0.log" Jul 22 02:30:12.721695 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.721677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc_dd75a623-9db2-4cc1-9605-ec992241481e/extract/0.log" Jul 22 02:30:12.851491 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:12.851465 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5656c7c8-57mgf_35f37ff4-2e7d-4f14-87cd-a586b704fa9c/authorino/0.log" Jul 22 02:30:13.675178 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:13.675150 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jc4xg_8f715ac2-2e75-485e-8044-35939459a27b/limitador/0.log" Jul 22 02:30:14.477721 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:14.477691 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d847747c-4wbml_11072660-23ef-4c15-91ed-0ad8c0ad6f1e/kube-auth-proxy/0.log" Jul 22 02:30:15.109726 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:15.109696 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cff9f6f56-fsz4n_2191f662-d32f-4565-b920-a3495f5e529d/router/0.log" Jul 22 02:30:15.852811 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:15.852784 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq844d_95f31988-f857-4b57-89fb-e65c741bba11/main/0.log" Jul 22 02:30:21.879655 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.879617 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6wcsf/must-gather-svtxk"] Jul 22 02:30:21.880058 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.879961 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" containerName="test-curl-7506-139998770984976" Jul 22 02:30:21.880058 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.879973 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" containerName="test-curl-7506-139998770984976" Jul 22 02:30:21.880058 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.880040 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="75a5ebb1-80fa-4aaf-ad61-306c046f9141" containerName="test-curl-7506-139998770984976" Jul 22 02:30:21.883146 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.883126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:21.885618 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.885603 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6wcsf\"/\"default-dockercfg-j2hsx\"" Jul 22 02:30:21.885813 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.885797 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6wcsf\"/\"openshift-service-ca.crt\"" Jul 22 02:30:21.886379 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.886362 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6wcsf\"/\"kube-root-ca.crt\"" Jul 22 02:30:21.895947 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.895925 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6wcsf/must-gather-svtxk"] Jul 22 02:30:21.915005 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.914984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdm74\" (UniqueName: \"kubernetes.io/projected/8e3bd119-6568-49f9-8b0f-918469c3aa92-kube-api-access-kdm74\") pod \"must-gather-svtxk\" (UID: \"8e3bd119-6568-49f9-8b0f-918469c3aa92\") " pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:21.915108 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:21.915058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e3bd119-6568-49f9-8b0f-918469c3aa92-must-gather-output\") pod \"must-gather-svtxk\" (UID: \"8e3bd119-6568-49f9-8b0f-918469c3aa92\") " pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:22.016125 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:22.016100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e3bd119-6568-49f9-8b0f-918469c3aa92-must-gather-output\") pod \"must-gather-svtxk\" (UID: \"8e3bd119-6568-49f9-8b0f-918469c3aa92\") " pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:22.016290 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:22.016269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdm74\" (UniqueName: \"kubernetes.io/projected/8e3bd119-6568-49f9-8b0f-918469c3aa92-kube-api-access-kdm74\") pod \"must-gather-svtxk\" (UID: \"8e3bd119-6568-49f9-8b0f-918469c3aa92\") " pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:22.016468 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:22.016450 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e3bd119-6568-49f9-8b0f-918469c3aa92-must-gather-output\") pod \"must-gather-svtxk\" (UID: \"8e3bd119-6568-49f9-8b0f-918469c3aa92\") " pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:22.030010 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:22.029989 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdm74\" (UniqueName: \"kubernetes.io/projected/8e3bd119-6568-49f9-8b0f-918469c3aa92-kube-api-access-kdm74\") pod \"must-gather-svtxk\" (UID: \"8e3bd119-6568-49f9-8b0f-918469c3aa92\") " pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:22.191911 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:22.191832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6wcsf/must-gather-svtxk" Jul 22 02:30:22.324449 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:22.324423 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6wcsf/must-gather-svtxk"] Jul 22 02:30:22.327878 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:30:22.327851 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e3bd119_6568_49f9_8b0f_918469c3aa92.slice/crio-25c5dca46137024c51e4e6c15d4dbeb8bc2d87ba22dc80c9faeafd8b41a12836 WatchSource:0}: Error finding container 25c5dca46137024c51e4e6c15d4dbeb8bc2d87ba22dc80c9faeafd8b41a12836: Status 404 returned error can't find the container with id 25c5dca46137024c51e4e6c15d4dbeb8bc2d87ba22dc80c9faeafd8b41a12836 Jul 22 02:30:23.154871 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:23.154765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6wcsf/must-gather-svtxk" event={"ID":"8e3bd119-6568-49f9-8b0f-918469c3aa92","Type":"ContainerStarted","Data":"25c5dca46137024c51e4e6c15d4dbeb8bc2d87ba22dc80c9faeafd8b41a12836"} Jul 22 02:30:24.164490 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:24.164458 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6wcsf/must-gather-svtxk" event={"ID":"8e3bd119-6568-49f9-8b0f-918469c3aa92","Type":"ContainerStarted","Data":"4d45d1b132756c13cccd260e1e27323b2283c61cba07bc804bdd4305e02554a6"} Jul 22 02:30:24.164490 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:24.164496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6wcsf/must-gather-svtxk" event={"ID":"8e3bd119-6568-49f9-8b0f-918469c3aa92","Type":"ContainerStarted","Data":"5e5654c78ec28791ac8c552ecbd3777e389cd1838e7d04f7f9300ae151a34188"} Jul 22 02:30:24.182005 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:24.181947 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6wcsf/must-gather-svtxk" podStartSLOduration=2.346669232 podStartE2EDuration="3.18192589s" totalImagesPullingTime="835.256658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:30:24.17883013 +0000 UTC m=+2743.730043845" watchObservedRunningTime="2026-07-22 02:30:24.18192589 +0000 UTC m=+2743.733139605" Jul 22 02:30:24.762146 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:24.762114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w6zb4_2412d691-73e5-4f34-a229-5b037e35536c/global-pull-secret-syncer/0.log" Jul 22 02:30:24.926438 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:24.926409 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wmhts_6ae640e3-9062-4185-a55a-6048287c5ff3/konnectivity-agent/0.log" Jul 22 02:30:24.999770 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:24.999716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-12.ec2.internal_8f8524ca7c47e8bba520d13ce2994f71/haproxy/0.log" Jul 22 02:30:28.931127 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:28.931084 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w_fc975532-22e2-492e-9c13-176575e4decd/extract/0.log" Jul 22 02:30:29.032693 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.032661 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w_fc975532-22e2-492e-9c13-176575e4decd/util/0.log" Jul 22 02:30:29.095565 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.095530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zzk5w_fc975532-22e2-492e-9c13-176575e4decd/pull/0.log" Jul 22 02:30:29.145827 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.145776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x_6fb73ba1-713d-4ba0-9a33-3315197dcbfa/extract/0.log" Jul 22 02:30:29.195364 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.195276 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x_6fb73ba1-713d-4ba0-9a33-3315197dcbfa/util/0.log" Jul 22 02:30:29.238457 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.238426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0km85x_6fb73ba1-713d-4ba0-9a33-3315197dcbfa/pull/0.log" Jul 22 02:30:29.288219 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.288179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq_c49fe75a-e876-46a2-9be2-35b2d1f73a26/extract/0.log" Jul 22 02:30:29.368178 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.368146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq_c49fe75a-e876-46a2-9be2-35b2d1f73a26/util/0.log" Jul 22 02:30:29.434404 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.434372 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k6rnq_c49fe75a-e876-46a2-9be2-35b2d1f73a26/pull/0.log" Jul 22 02:30:29.507346 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.507251 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc_dd75a623-9db2-4cc1-9605-ec992241481e/extract/0.log" Jul 22 02:30:29.560787 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.560756 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc_dd75a623-9db2-4cc1-9605-ec992241481e/util/0.log" Jul 22 02:30:29.600603 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:29.600573 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jsfbc_dd75a623-9db2-4cc1-9605-ec992241481e/pull/0.log" Jul 22 02:30:30.160188 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:30.160152 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5656c7c8-57mgf_35f37ff4-2e7d-4f14-87cd-a586b704fa9c/authorino/0.log" Jul 22 02:30:30.806243 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:30.806213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jc4xg_8f715ac2-2e75-485e-8044-35939459a27b/limitador/0.log" Jul 22 02:30:32.874313 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:32.874262 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-w7kbs_957a46c5-dbaa-4221-8fd4-2516761a1548/cluster-monitoring-operator/0.log" Jul 22 02:30:33.091190 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:33.091133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k5s8_7c241f74-2e80-4b36-9daa-ca1872c83354/node-exporter/0.log" Jul 22 02:30:33.149233 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:33.149122 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k5s8_7c241f74-2e80-4b36-9daa-ca1872c83354/kube-rbac-proxy/0.log" Jul 22 02:30:33.192809 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:33.192786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k5s8_7c241f74-2e80-4b36-9daa-ca1872c83354/init-textfile/0.log" Jul 22 02:30:34.053336 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.053295 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-9f9k2_5afa9743-099d-463d-bb7b-ab1cfd3fb0b9/prometheus-operator-admission-webhook/0.log" Jul 22 02:30:34.475108 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.475055 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj"] Jul 22 02:30:34.479714 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.479688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.498300 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.498272 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj"] Jul 22 02:30:34.550530 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.549915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-sys\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.550530 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.549986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-lib-modules\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.550530 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.550025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-podres\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.550530 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.550124 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k62b5\" (UniqueName: \"kubernetes.io/projected/800cf63b-5229-4097-b207-76560f20d501-kube-api-access-k62b5\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.550530 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.550151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-proc\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.650692 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.650654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k62b5\" (UniqueName: \"kubernetes.io/projected/800cf63b-5229-4097-b207-76560f20d501-kube-api-access-k62b5\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.650692 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.650694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-proc\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.650947 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.650793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-proc\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.650947 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.650845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-sys\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.650947 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.650890 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-sys\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.650947 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.650904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-lib-modules\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.650947 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.650943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-podres\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.651190 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.651059 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-lib-modules\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.651190 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.651082 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/800cf63b-5229-4097-b207-76560f20d501-podres\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.666140 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.666114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k62b5\" (UniqueName: \"kubernetes.io/projected/800cf63b-5229-4097-b207-76560f20d501-kube-api-access-k62b5\") pod \"perf-node-gather-daemonset-jfbqj\" (UID: \"800cf63b-5229-4097-b207-76560f20d501\") " pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:34.794589 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:34.794511 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:35.010518 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:35.010350 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj"] Jul 22 02:30:35.013476 ip-10-0-141-12 kubenswrapper[2579]: W0722 02:30:35.013446 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod800cf63b_5229_4097_b207_76560f20d501.slice/crio-a52ff961c24f7d4ffb8c82f47952908cb937ae42a28cb5ef74646558f71439f2 WatchSource:0}: Error finding container a52ff961c24f7d4ffb8c82f47952908cb937ae42a28cb5ef74646558f71439f2: Status 404 returned error can't find the container with id a52ff961c24f7d4ffb8c82f47952908cb937ae42a28cb5ef74646558f71439f2 Jul 22 02:30:35.249218 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:35.249182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" event={"ID":"800cf63b-5229-4097-b207-76560f20d501","Type":"ContainerStarted","Data":"52175fb4e632e40579280ae11208ffae86dd160c83711240f875e3d585c86d29"} Jul 22 02:30:35.249658 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:35.249238 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" event={"ID":"800cf63b-5229-4097-b207-76560f20d501","Type":"ContainerStarted","Data":"a52ff961c24f7d4ffb8c82f47952908cb937ae42a28cb5ef74646558f71439f2"} Jul 22 02:30:35.249658 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:35.249286 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:35.267627 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:35.267569 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" podStartSLOduration=1.26754812 podStartE2EDuration="1.26754812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:30:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:30:35.266999443 +0000 UTC m=+2754.818213169" watchObservedRunningTime="2026-07-22 02:30:35.26754812 +0000 UTC m=+2754.818761834" Jul 22 02:30:35.608354 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:35.608326 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-nvw6d_0a48b484-5451-4460-8cf5-fd2479a239be/networking-console-plugin/0.log" Jul 22 02:30:36.141196 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:36.141167 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/1.log" Jul 22 02:30:36.149353 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:36.149327 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-8t54x_772900da-da16-4967-a7c6-d802a473d9b8/console-operator/2.log" Jul 22 02:30:36.722676 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:36.722644 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-b6nlr_a39cad57-466c-470b-8a19-a2ba571ac438/download-server/0.log" Jul 22 02:30:37.405460 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:37.405431 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-bwhwz_a057728c-887f-47e5-8579-4f00f07a28d0/volume-data-source-validator/0.log" Jul 22 02:30:38.761070 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:38.761039 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svlw6_209ee414-fb96-40ca-923b-4f5cd09cf320/dns/0.log" Jul 22 02:30:38.789793 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:38.789691 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svlw6_209ee414-fb96-40ca-923b-4f5cd09cf320/kube-rbac-proxy/0.log" Jul 22 02:30:38.821081 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:38.821056 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52w6n_f919c0f1-1f3a-4be2-ab81-6daeb2435c0e/dns-node-resolver/0.log" Jul 22 02:30:39.523206 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:39.523168 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9phhl_832d1177-661d-466e-813c-1edcaff38e0b/node-ca/0.log" Jul 22 02:30:40.916474 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:40.916439 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d847747c-4wbml_11072660-23ef-4c15-91ed-0ad8c0ad6f1e/kube-auth-proxy/0.log" Jul 22 02:30:41.158909 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:41.158884 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cff9f6f56-fsz4n_2191f662-d32f-4565-b920-a3495f5e529d/router/0.log" Jul 22 02:30:41.272770 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:41.272673 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6wcsf/perf-node-gather-daemonset-jfbqj" Jul 22 02:30:41.958610 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:41.958573 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5vthq_001e6900-63b4-4ea4-a1f6-18e6b0517ce9/serve-healthcheck-canary/0.log" Jul 22 02:30:42.666555 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:42.666530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-c8rqz_1311591e-2c35-42cc-9911-9b536a652a9e/insights-operator/1.log" Jul 22 02:30:42.669177 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:42.669150 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-c8rqz_1311591e-2c35-42cc-9911-9b536a652a9e/insights-operator/0.log" Jul 22 02:30:42.893717 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:42.893688 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9hgn_8e5c8b14-7e4b-413a-be39-d59acef15c4b/kube-rbac-proxy/0.log" Jul 22 02:30:42.945350 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:42.945273 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9hgn_8e5c8b14-7e4b-413a-be39-d59acef15c4b/exporter/0.log" Jul 22 02:30:42.976320 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:42.976286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9hgn_8e5c8b14-7e4b-413a-be39-d59acef15c4b/extractor/0.log" Jul 22 02:30:45.135089 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:45.135058 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d847747c-4wbml_11072660-23ef-4c15-91ed-0ad8c0ad6f1e/kube-auth-proxy/0.log" Jul 22 02:30:45.295538 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:45.295510 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cff9f6f56-fsz4n_2191f662-d32f-4565-b920-a3495f5e529d/router/0.log" Jul 22 02:30:46.128095 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:46.128026 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rcdpr_fc6c02d4-4189-45ed-b8eb-ced8625af5be/manager/0.log" Jul 22 02:30:46.357870 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:46.357841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585784b644-n2jf2_d8193bf6-d109-41d5-a13d-42bb1583756a/manager/0.log" Jul 22 02:30:46.388084 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:46.388062 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585784b644-n2jf2_d8193bf6-d109-41d5-a13d-42bb1583756a/copy-manifests/0.log" Jul 22 02:30:46.670200 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:46.670128 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d847747c-4wbml_11072660-23ef-4c15-91ed-0ad8c0ad6f1e/kube-auth-proxy/0.log" Jul 22 02:30:46.845539 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:46.845500 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cff9f6f56-fsz4n_2191f662-d32f-4565-b920-a3495f5e529d/router/0.log" Jul 22 02:30:47.582565 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:47.582530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb968c57-5dm7t_223f5708-cf42-4d59-bac0-3616b1eb82cb/manager/0.log" Jul 22 02:30:47.650756 ip-10-0-141-12 kubenswrapper[2579]: I0722 02:30:47.650721 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-26kkt_6ec0d113-016f-4661-abad-3e85850d41fd/openshift-lws-operator/0.log"