Jul 15 16:37:03.138441 ip-10-0-142-145 systemd[1]: Starting Kubernetes Kubelet... Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.653157 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657551 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657562 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657566 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657569 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657572 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657574 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657578 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:37:04.694612 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657580 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657583 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657586 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657589 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657592 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657596 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657598 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657602 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657604 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657607 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657610 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657612 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657615 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657618 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657627 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657630 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657633 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657635 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657638 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657640 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:37:04.695620 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657643 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657645 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657648 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657651 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657653 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657656 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657658 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657661 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657663 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657666 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657668 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657671 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657673 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657676 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657679 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657682 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657684 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657686 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657689 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657693 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:37:04.696382 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657696 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657698 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657701 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657703 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657706 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657709 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657712 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657715 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657719 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657723 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657726 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657729 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657731 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657734 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657737 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657740 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657743 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657746 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657749 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657751 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:37:04.696960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657753 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657756 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657758 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657761 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657764 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657767 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657769 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657772 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657775 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657777 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657780 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657783 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657785 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657789 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657791 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657796 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657800 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657803 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657806 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:37:04.697617 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657809 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657812 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657814 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657817 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657819 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657822 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657824 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657827 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657829 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657832 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657834 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657837 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.657841 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658684 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658692 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658697 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658700 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658703 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:37:04.698224 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658707 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658711 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658714 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658717 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658720 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658723 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658726 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658729 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658732 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658736 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658738 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658742 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658744 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658747 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658749 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658753 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658757 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658760 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658762 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:37:04.698699 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658765 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658768 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658771 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658773 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658776 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658779 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658782 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658785 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658788 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658790 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658793 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658796 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658798 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658801 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658803 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658806 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658809 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658811 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658814 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:37:04.699340 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658816 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658819 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658821 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658824 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658827 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658830 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658832 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658835 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658838 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658841 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658844 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658847 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658849 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658852 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658854 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658858 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658861 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658863 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658866 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658869 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658872 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:37:04.699983 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658874 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658877 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658880 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658882 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658885 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658887 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658889 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658892 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658895 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658897 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658900 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658902 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658905 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658907 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658910 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658912 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658916 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658918 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658921 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658924 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:37:04.700683 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658926 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658929 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658931 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658934 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658936 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658939 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658941 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658944 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658946 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658949 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658951 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658953 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658956 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658959 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.658962 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659385 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659393 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659396 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659399 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:37:04.701296 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659402 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659407 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659410 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659413 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659419 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659423 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659425 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659428 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659431 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659435 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659438 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659440 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659443 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659446 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659448 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659451 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659453 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659456 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659458 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:37:04.701890 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659462 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659465 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659467 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659470 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659472 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659475 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659477 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659480 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659482 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659485 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659489 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659492 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659494 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659496 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659499 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659502 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659504 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659509 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659511 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659514 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:37:04.702466 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659516 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659519 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659522 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659525 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659527 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659530 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659532 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659535 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659537 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659540 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659542 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659545 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659547 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659550 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659552 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659555 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659557 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659560 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659562 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659565 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:37:04.703091 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659567 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659570 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659574 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659577 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659579 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659582 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659584 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659586 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659590 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659596 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659598 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659601 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659604 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659606 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659609 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659612 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659615 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659617 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659620 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659622 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:37:04.703619 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659625 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659628 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659630 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659632 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659635 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659637 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659640 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659642 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659645 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659647 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659650 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659652 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659655 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659657 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659661 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.659664 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659728 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659739 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659746 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659752 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659758 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 16:37:04.882241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659765 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 16:37:04.731359 ip-10-0-142-145 systemd[1]: Started Kubernetes Kubelet. Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659772 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659777 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659780 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659783 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659787 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659790 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659793 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659797 2565 flags.go:64] FLAG: --cgroup-root="" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659800 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659803 2565 flags.go:64] FLAG: --client-ca-file="" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659806 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659809 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659815 2565 flags.go:64] FLAG: --cluster-domain="" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659818 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659821 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659824 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659828 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659831 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659834 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659837 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659841 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659844 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659847 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 16:37:04.904224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659850 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659854 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659857 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659861 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659864 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659867 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659870 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659873 2565 flags.go:64] FLAG: --enable-server="true" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659877 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659882 2565 flags.go:64] FLAG: --event-burst="100" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659885 2565 flags.go:64] FLAG: --event-qps="50" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659888 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659891 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659894 2565 flags.go:64] FLAG: --eviction-hard="" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659897 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659900 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659903 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659907 2565 flags.go:64] FLAG: --eviction-soft="" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659909 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659912 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659915 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659918 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659921 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659924 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659927 2565 flags.go:64] FLAG: --feature-gates="" Jul 15 16:37:04.905349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659930 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659933 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659937 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659940 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659943 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659946 2565 flags.go:64] FLAG: --help="false" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659949 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-142-145.ec2.internal" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659952 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659956 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659959 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659962 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659966 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659969 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659972 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659974 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659978 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659981 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659984 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659987 2565 flags.go:64] FLAG: --kube-reserved="" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659990 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659993 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659996 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.659999 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660002 2565 flags.go:64] FLAG: --lock-file="" Jul 15 16:37:04.906660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660004 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660008 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660010 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660028 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660031 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660034 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660037 2565 flags.go:64] FLAG: --logging-format="text" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660040 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660043 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660046 2565 flags.go:64] FLAG: --manifest-url="" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660049 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660053 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660056 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660060 2565 flags.go:64] FLAG: --max-pods="110" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660063 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660066 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660070 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660073 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660076 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660079 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660082 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660091 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660094 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660098 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 16:37:04.907765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660101 2565 flags.go:64] FLAG: --pod-cidr="" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660104 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660110 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660113 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660116 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660118 2565 flags.go:64] FLAG: --port="10250" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660122 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660124 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-012856e22e7c7d31f" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660127 2565 flags.go:64] FLAG: --qos-reserved="" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660130 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660134 2565 flags.go:64] FLAG: --register-node="true" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660137 2565 flags.go:64] FLAG: --register-with-taints="" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660140 2565 flags.go:64] FLAG: --registry-burst="10" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660143 2565 flags.go:64] FLAG: --registry-qps="5" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660146 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660148 2565 flags.go:64] FLAG: --reserved-memory="" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660152 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660157 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660162 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660166 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660171 2565 flags.go:64] FLAG: --runonce="false" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660175 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660179 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660182 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660186 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 16:37:04.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660189 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660192 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660195 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660198 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660201 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660204 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660207 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660211 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660214 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660217 2565 flags.go:64] FLAG: --system-cgroups="" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660219 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660225 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660227 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660230 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660234 2565 flags.go:64] FLAG: --tls-min-version="" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660237 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660240 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660243 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660246 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660249 2565 flags.go:64] FLAG: --v="2" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660253 2565 flags.go:64] FLAG: --version="false" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660257 2565 flags.go:64] FLAG: --vmodule="" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660260 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.660264 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660397 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:37:04.911898 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660402 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660405 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660408 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660411 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660413 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660416 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660420 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660423 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660425 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660428 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660430 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660433 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660435 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660438 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660442 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660444 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660447 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660449 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660452 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660455 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:37:04.913644 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660458 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660460 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660463 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660465 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660468 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660471 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660474 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660476 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660479 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660482 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660485 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660487 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660490 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660493 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660496 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660498 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660501 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660504 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660507 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660510 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:37:04.914530 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660512 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660515 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660519 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660522 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660525 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660528 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660532 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660535 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660538 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660540 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660543 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660546 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660548 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660551 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660554 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660556 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660558 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660562 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660564 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:37:04.915846 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660568 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660570 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660573 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660576 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660579 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660581 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660585 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660588 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660591 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660594 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660596 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660601 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660603 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660606 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660608 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660611 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660613 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660616 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660619 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:37:04.916721 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660623 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660625 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660628 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660630 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660633 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660636 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660647 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660650 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660653 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660655 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660658 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660661 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660663 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660666 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660669 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660672 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660674 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660678 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660682 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:37:04.921642 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.660685 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.661434 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.667904 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.667920 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.667940 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.667946 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668000 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668005 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668008 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668011 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668028 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668031 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668034 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668037 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668040 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:37:04.922535 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668043 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668045 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668048 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668051 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668053 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668056 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668059 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668061 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668065 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668067 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668070 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668073 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668077 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668082 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668086 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668089 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668092 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668094 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668097 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668100 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:37:04.923764 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668103 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668106 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668108 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668111 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668114 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668117 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668120 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668122 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668125 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668128 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668131 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668134 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668136 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668140 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668142 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668145 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668148 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668151 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668154 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668157 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:37:04.924650 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668159 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668162 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668165 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668168 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668170 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668173 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668176 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668179 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668182 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668184 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668187 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668189 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668192 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668194 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668197 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668199 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668202 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668205 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668207 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:37:04.925710 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668211 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668215 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668217 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668220 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668223 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668225 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668229 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668232 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668235 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668241 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668244 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668247 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668250 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668253 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668256 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668259 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668261 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668264 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668267 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:37:05.135919 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668269 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668272 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668274 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668277 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668279 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668282 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668284 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668287 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668289 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668292 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668294 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668297 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.668302 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668409 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668414 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 16:37:05.137273 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668417 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668420 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668423 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668428 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668431 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668434 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668437 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668439 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668443 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668446 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668449 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668452 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668454 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668457 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668460 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668462 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668465 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668468 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668471 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 16:37:05.138363 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668473 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668476 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668478 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668481 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668483 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668486 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668488 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668491 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668494 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668496 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668499 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668501 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668504 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668506 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668509 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668511 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668515 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668518 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668520 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668523 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 16:37:05.139879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668525 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668529 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668532 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668535 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668537 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668540 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668542 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668545 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668548 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668550 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668553 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668556 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668559 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668561 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668564 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668569 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668572 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668575 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668578 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668581 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 16:37:05.140962 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668583 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668586 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668589 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668591 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668595 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668597 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668600 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668603 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668606 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668609 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668611 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668614 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668617 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668621 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668623 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668627 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668630 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668633 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668635 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 16:37:05.141848 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668645 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668649 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668652 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668656 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668659 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668662 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668665 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668668 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668671 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668674 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668677 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668679 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668682 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668685 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668687 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668690 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668692 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668695 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 16:37:05.144042 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:04.668697 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.668702 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.668799 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.671717 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.673256 2565 server.go:1019] "Starting client certificate rotation" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.673362 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.673407 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.676698 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.679087 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.688626 2565 log.go:25] "Validated CRI v1 runtime API" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.696010 2565 log.go:25] "Validated CRI v1 image API" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.697831 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 16:37:05.144921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.704578 2565 fs.go:135] Filesystem UUIDs: map[29f3aa18-d90d-4dba-b807-9a26a17f5dfa:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e8771801-81ae-4722-a176-9a6c09f4dec1:/dev/nvme0n1p4] Jul 15 16:37:05.146239 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.704604 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 16:37:05.146239 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.707031 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.709772 2565 manager.go:216] Machine: {Timestamp:2026-07-15 16:37:04.709261997 +0000 UTC m=+0.393511216 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3138601 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24685091ff25f479f658fe067c8a91 SystemUUID:ec246850-91ff-25f4-79f6-58fe067c8a91 BootID:b8ee8a95-9f49-40d5-a532-1f7c5521484c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:91:90:35:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:91:90:35:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:3b:81:33:10:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.709875 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.709991 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.713142 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.713166 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.714091 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.714101 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.714108 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.714647 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.715346 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.719413 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.719541 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.719570 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.719582 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.719604 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.719616 2565 kubelet.go:398] "Adding apiserver pod source" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.719626 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 16:37:05.147554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.720009 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.720047 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.723223 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.725606 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.725637 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726205 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726219 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726225 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726231 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726239 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726244 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726510 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726516 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726522 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726543 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726555 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726569 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726614 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.726620 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.730315 2565 server.go:1268] "Started kubelet" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.730486 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.730531 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.730523 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.731628 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.731757 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.731955 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.732009 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.737810 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.739881 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-72xb5" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.740533 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.740541 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.741191 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.741206 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.743567 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.744072 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744226 2565 factory.go:55] Registering systemd factory Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744240 2565 factory.go:223] Registration of the systemd container factory successfully Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744304 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744315 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744590 2565 factory.go:153] Registering CRI-O factory Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744607 2565 factory.go:223] Registration of the crio container factory successfully Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744664 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744687 2565 factory.go:103] Registering Raw factory Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.744704 2565 manager.go:1196] Started watching for new ooms in manager Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.745160 2565 manager.go:349] Starting recovery of all containers Jul 15 16:37:05.148455 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.745195 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.744348 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-145.ec2.internal.18c283e5a4f159b9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-145.ec2.internal,UID:ip-10-0-142-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-145.ec2.internal,},FirstTimestamp:2026-07-15 16:37:04.730167737 +0000 UTC m=+0.414416954,LastTimestamp:2026-07-15 16:37:04.730167737 +0000 UTC m=+0.414416954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-145.ec2.internal,}" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.747619 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-72xb5" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.750340 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.754511 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.754567 2565 manager.go:354] Recovery completed Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.754588 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.759245 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.765319 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.765345 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.765355 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.766460 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.766470 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.766474 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.766486 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.767278 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.767303 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.767314 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.768536 2565 policy_none.go:49] "None policy: Start" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.768549 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.768562 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.770608 2565 policy_none.go:47] "Start" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.806633 2565 manager.go:337] "Starting Device Plugin manager" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.806832 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.806847 2565 server.go:87] "Starting device plugin registration server" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.807129 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.807141 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.807228 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.807315 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.807325 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.807846 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.807885 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.892674 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.892716 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.892738 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.892771 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.898348 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.907843 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.908636 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:37:05.150236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.908672 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.908688 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.908713 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.930743 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.930760 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-145.ec2.internal\": node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:04.956056 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.992972 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal"] Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:04.993096 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.000692 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.000724 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.000737 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.003192 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.003321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.003358 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.004145 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.004175 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.004186 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.004144 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.004251 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.004261 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.006613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.006638 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.007439 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientMemory" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.007467 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.007480 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeHasSufficientPID" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.032784 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-145.ec2.internal\" not found" node="ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.036572 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-145.ec2.internal\" not found" node="ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.045940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af63cb8e054077d4c45fc3d59353744c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal\" (UID: \"af63cb8e054077d4c45fc3d59353744c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.045965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af63cb8e054077d4c45fc3d59353744c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal\" (UID: \"af63cb8e054077d4c45fc3d59353744c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.045983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bbefd012d364337eca5b8c7e595d372-config\") pod \"kube-apiserver-proxy-ip-10-0-142-145.ec2.internal\" (UID: \"7bbefd012d364337eca5b8c7e595d372\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.057151 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.151798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.146480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af63cb8e054077d4c45fc3d59353744c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal\" (UID: \"af63cb8e054077d4c45fc3d59353744c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.153365 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.146504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af63cb8e054077d4c45fc3d59353744c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal\" (UID: \"af63cb8e054077d4c45fc3d59353744c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.153365 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.146544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bbefd012d364337eca5b8c7e595d372-config\") pod \"kube-apiserver-proxy-ip-10-0-142-145.ec2.internal\" (UID: \"7bbefd012d364337eca5b8c7e595d372\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.153365 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.146551 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af63cb8e054077d4c45fc3d59353744c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal\" (UID: \"af63cb8e054077d4c45fc3d59353744c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.153365 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.146568 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af63cb8e054077d4c45fc3d59353744c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal\" (UID: \"af63cb8e054077d4c45fc3d59353744c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.153365 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.146625 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bbefd012d364337eca5b8c7e595d372-config\") pod \"kube-apiserver-proxy-ip-10-0-142-145.ec2.internal\" (UID: \"7bbefd012d364337eca5b8c7e595d372\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.158028 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.157575 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.374891 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.258594 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.374891 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.334807 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.374891 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.339124 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" Jul 15 16:37:05.374891 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.359530 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.600662 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.460197 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.600662 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.560809 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.774891 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.661551 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.774891 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.672705 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 16:37:05.774891 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.672856 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 16:37:05.774891 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.752172 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 16:32:04 +0000 UTC" deadline="2027-12-10 09:34:08.138719122 +0000 UTC" Jul 15 16:37:05.774891 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.752201 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12304h57m2.386521597s" Jul 15 16:37:05.774891 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.761780 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:05.930572 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.862052 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:06.065227 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:05.950235 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbefd012d364337eca5b8c7e595d372.slice/crio-730d79ae835361be427cebbdde71da5cf28b0adc5e0b62f2d9612149a8f2eb6a WatchSource:0}: Error finding container 730d79ae835361be427cebbdde71da5cf28b0adc5e0b62f2d9612149a8f2eb6a: Status 404 returned error can't find the container with id 730d79ae835361be427cebbdde71da5cf28b0adc5e0b62f2d9612149a8f2eb6a Jul 15 16:37:06.065227 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.957423 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:37:06.065227 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:05.959438 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:37:06.065227 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:05.962746 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:06.065227 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.062981 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-145.ec2.internal\" not found" Jul 15 16:37:06.204299 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.096499 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:37:06.204299 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.144439 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" Jul 15 16:37:06.204299 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.157521 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 16:37:06.204299 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.158472 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" Jul 15 16:37:06.204299 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.165573 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 16:37:06.394226 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.340826 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:37:06.720691 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.720421 2565 apiserver.go:52] "Watching apiserver" Jul 15 16:37:06.729351 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.729321 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 16:37:06.729744 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.729714 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-s7b8h","openshift-network-diagnostics/network-check-target-bzr9b","openshift-network-operator/iptables-alerter-xwbq6","openshift-ovn-kubernetes/ovnkube-node-4d858","kube-system/global-pull-secret-syncer-vkt8f","kube-system/konnectivity-agent-mkl2m","openshift-cluster-node-tuning-operator/tuned-j4vkq","openshift-dns/node-resolver-9q65d","openshift-image-registry/node-ca-w9czq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal","openshift-multus/multus-7cc7c","kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc","openshift-multus/multus-additional-cni-plugins-8pmdx"] Jul 15 16:37:06.732261 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.732240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:06.734337 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.734315 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:06.734439 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.734387 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:06.735254 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.735233 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-npjn5\"" Jul 15 16:37:06.735507 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.735487 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 16:37:06.735696 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.735680 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 16:37:06.736563 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.736544 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.738786 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.738670 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:06.738786 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.738712 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 16:37:06.738786 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.738745 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:06.739376 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.739286 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:37:06.739461 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.739444 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k8v5m\"" Jul 15 16:37:06.739527 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.739504 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 16:37:06.741074 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.740925 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.741074 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.741061 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 16:37:06.743106 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.743086 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9nd45\"" Jul 15 16:37:06.743489 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.743368 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:37:06.743489 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.743428 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 16:37:06.743657 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.743640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.743712 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.743695 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:06.745868 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.745598 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.748240 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748222 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.748558 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748409 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 16:37:06.748558 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748432 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mfw9d\"" Jul 15 16:37:06.748558 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748459 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 16:37:06.748756 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748622 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 16:37:06.748756 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748687 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 16:37:06.748855 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748751 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 16:37:06.748945 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.748927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 16:37:06.750657 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.750299 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.751061 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.751043 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 16:37:06.751446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.751428 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 16:37:06.752065 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.752042 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m754l\"" Jul 15 16:37:06.752688 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.752558 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 16:37:06.752688 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.752664 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.753308 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.753074 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 16:37:06.753308 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.753108 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 16:37:06.753308 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.753195 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5s8fd\"" Jul 15 16:37:06.754032 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.753993 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 16:37:06.756055 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.755622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.757708 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.757688 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.759157 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.759138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 16:37:06.760203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.759841 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mfmmr\"" Jul 15 16:37:06.760203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760054 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 16:37:06.760203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760165 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 16:37:06.760504 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760484 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 16:37:06.760552 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:06.760552 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760538 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-928t5\"" Jul 15 16:37:06.760656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760553 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-kubernetes\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.760656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760586 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-var-lib-kubelet\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.760656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-952h5\" (UniqueName: \"kubernetes.io/projected/f7341943-babd-4728-9e31-3c55b132e63e-kube-api-access-952h5\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.760656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:06.760824 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-cni-bin\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.760824 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-modprobe-d\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.760824 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-run\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.760824 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-lib-modules\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.760996 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760811 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 16:37:06.760996 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-slash\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.760996 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-log-socket\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.760996 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovnkube-config\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.760996 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovn-node-metrics-cert\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.760997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysctl-d\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.761235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7341943-babd-4728-9e31-3c55b132e63e-etc-tuned\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.761235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-run-netns\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b615616-22a1-4167-bd7e-404c257160b4-konnectivity-ca\") pod \"konnectivity-agent-mkl2m\" (UID: \"3b615616-22a1-4167-bd7e-404c257160b4\") " pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:06.761235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-systemd\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.761235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7341943-babd-4728-9e31-3c55b132e63e-tmp\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.761235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761264 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-var-lib-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-ovn\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761362 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761420 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysctl-conf\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhpl\" (UniqueName: \"kubernetes.io/projected/e7440086-cac0-41f4-87d0-5f42a2e670d2-kube-api-access-fhhpl\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-systemd-units\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-etc-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-cni-netd\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-iptables-alerter-script\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761651 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-sys\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-systemd\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s5wh\" (UniqueName: \"kubernetes.io/projected/5a45789b-c3c4-4910-8388-8ee23bf1d4af-kube-api-access-2s5wh\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.761847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b615616-22a1-4167-bd7e-404c257160b4-agent-certs\") pod \"konnectivity-agent-mkl2m\" (UID: \"3b615616-22a1-4167-bd7e-404c257160b4\") " pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-host-slash\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.761960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-host\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/373f1b76-aa65-4f5c-a05e-77de22119a3d-kubelet-config\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-kubelet\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762091 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-node-log\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-env-overrides\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hx55\" (UniqueName: \"kubernetes.io/projected/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-kube-api-access-8hx55\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.762220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762206 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 16:37:06.762577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762246 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-666td\"" Jul 15 16:37:06.762577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysconfig\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.762577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/373f1b76-aa65-4f5c-a05e-77de22119a3d-dbus\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.762577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762310 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 16:37:06.762577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-run-ovn-kubernetes\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.762577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.762381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovnkube-script-lib\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.774770 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.774744 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n52m9" Jul 15 16:37:06.782836 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.782814 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n52m9" Jul 15 16:37:06.844732 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.844658 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 16:37:06.863312 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b615616-22a1-4167-bd7e-404c257160b4-konnectivity-ca\") pod \"konnectivity-agent-mkl2m\" (UID: \"3b615616-22a1-4167-bd7e-404c257160b4\") " pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:06.863461 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.863461 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-var-lib-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.863461 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-ovn\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.863461 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-multus-certs\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmjwc\" (UniqueName: \"kubernetes.io/projected/49998592-3f25-4036-9b66-0152e6e6a96e-kube-api-access-kmjwc\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.863476 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-systemd-units\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-etc-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.863574 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret podName:373f1b76-aa65-4f5c-a05e-77de22119a3d nodeName:}" failed. No retries permitted until 2026-07-15 16:37:07.363532971 +0000 UTC m=+3.047782176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret") pod "global-pull-secret-syncer-vkt8f" (UID: "373f1b76-aa65-4f5c-a05e-77de22119a3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863583 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-etc-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863616 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-systemd-units\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.863647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2twk\" (UniqueName: \"kubernetes.io/projected/1b7e6012-1e83-42e3-a85d-abb838b5661f-kube-api-access-q2twk\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863575 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-ovn\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-kubelet\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863669 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863582 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-var-lib-openvswitch\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-etc-kubernetes\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-sys\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-systemd\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-tmp-dir\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863815 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-sys\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-cni-multus\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863847 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-run-systemd\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-device-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b615616-22a1-4167-bd7e-404c257160b4-agent-certs\") pod \"konnectivity-agent-mkl2m\" (UID: \"3b615616-22a1-4167-bd7e-404c257160b4\") " pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-host\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.863979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hx55\" (UniqueName: \"kubernetes.io/projected/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-kube-api-access-8hx55\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.864084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/373f1b76-aa65-4f5c-a05e-77de22119a3d-dbus\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovnkube-script-lib\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864078 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-host\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-conf-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864149 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b615616-22a1-4167-bd7e-404c257160b4-konnectivity-ca\") pod \"konnectivity-agent-mkl2m\" (UID: \"3b615616-22a1-4167-bd7e-404c257160b4\") " pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-952h5\" (UniqueName: \"kubernetes.io/projected/f7341943-babd-4728-9e31-3c55b132e63e-kube-api-access-952h5\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-cni-bin\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-hosts-file\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-cni-bin\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864260 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-registration-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864296 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/373f1b76-aa65-4f5c-a05e-77de22119a3d-dbus\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cnibin\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-modprobe-d\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-cni-bin\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.864904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-run\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-lib-modules\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-slash\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-modprobe-d\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovn-node-metrics-cert\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.864473 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.864523 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:07.364505116 +0000 UTC m=+3.048754325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-slash\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-lib-modules\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-run\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-system-cni-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdkxj\" (UniqueName: \"kubernetes.io/projected/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-kube-api-access-mdkxj\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7341943-babd-4728-9e31-3c55b132e63e-etc-tuned\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-run-netns\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864741 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovnkube-script-lib\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864805 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-run-netns\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.865611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-cni-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-k8s-cni-cncf-io\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-systemd\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7341943-babd-4728-9e31-3c55b132e63e-tmp\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864897 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-systemd\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.864997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysctl-conf\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865039 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhpl\" (UniqueName: \"kubernetes.io/projected/e7440086-cac0-41f4-87d0-5f42a2e670d2-kube-api-access-fhhpl\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-cni-netd\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-socket-dir-parent\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-daemon-config\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-sys-fs\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-os-release\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.866429 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-iptables-alerter-script\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s5wh\" (UniqueName: \"kubernetes.io/projected/5a45789b-c3c4-4910-8388-8ee23bf1d4af-kube-api-access-2s5wh\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh26x\" (UniqueName: \"kubernetes.io/projected/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-kube-api-access-qh26x\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-os-release\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865328 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysctl-conf\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-hostroot\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-host-slash\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/373f1b76-aa65-4f5c-a05e-77de22119a3d-kubelet-config\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-kubelet\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-node-log\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-env-overrides\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865515 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-cni-netd\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865487 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-kubelet\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865565 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-host-slash\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysconfig\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-run-ovn-kubernetes\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.867205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-system-cni-dir\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-kubernetes\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-var-lib-kubelet\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-socket-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865781 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/373f1b76-aa65-4f5c-a05e-77de22119a3d-kubelet-config\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cni-binary-copy\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865824 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-iptables-alerter-script\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkbn9\" (UniqueName: \"kubernetes.io/projected/df14dead-eee8-4fc4-8e75-e7bebb67aeec-kube-api-access-gkbn9\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865830 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-kubernetes\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865878 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-host-run-ovn-kubernetes\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865879 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysconfig\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-log-socket\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865923 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-env-overrides\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865930 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-var-lib-kubelet\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.865964 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-node-log\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovnkube-config\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b7e6012-1e83-42e3-a85d-abb838b5661f-host\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.868036 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866054 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a45789b-c3c4-4910-8388-8ee23bf1d4af-log-socket\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysctl-d\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b7e6012-1e83-42e3-a85d-abb838b5661f-serviceca\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-cnibin\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-cni-binary-copy\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866190 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7341943-babd-4728-9e31-3c55b132e63e-etc-sysctl-d\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-netns\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.866487 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovnkube-config\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.868453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7341943-babd-4728-9e31-3c55b132e63e-tmp\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.868620 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a45789b-c3c4-4910-8388-8ee23bf1d4af-ovn-node-metrics-cert\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.868795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.868783 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b615616-22a1-4167-bd7e-404c257160b4-agent-certs\") pod \"konnectivity-agent-mkl2m\" (UID: \"3b615616-22a1-4167-bd7e-404c257160b4\") " pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:06.869203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.868927 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7341943-babd-4728-9e31-3c55b132e63e-etc-tuned\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.875994 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.875975 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:37:06.875994 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.875996 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:37:06.876158 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.876009 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2l274 for pod openshift-network-diagnostics/network-check-target-bzr9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:06.876158 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:06.876084 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274 podName:43b0ce4a-0960-4747-a0c5-c4e958daf1d8 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:07.376068349 +0000 UTC m=+3.060317552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2l274" (UniqueName: "kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274") pod "network-check-target-bzr9b" (UID: "43b0ce4a-0960-4747-a0c5-c4e958daf1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:06.879198 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.879177 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s5wh\" (UniqueName: \"kubernetes.io/projected/5a45789b-c3c4-4910-8388-8ee23bf1d4af-kube-api-access-2s5wh\") pod \"ovnkube-node-4d858\" (UID: \"5a45789b-c3c4-4910-8388-8ee23bf1d4af\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:06.880428 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.880385 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-952h5\" (UniqueName: \"kubernetes.io/projected/f7341943-babd-4728-9e31-3c55b132e63e-kube-api-access-952h5\") pod \"tuned-j4vkq\" (UID: \"f7341943-babd-4728-9e31-3c55b132e63e\") " pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:06.881042 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.881002 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhpl\" (UniqueName: \"kubernetes.io/projected/e7440086-cac0-41f4-87d0-5f42a2e670d2-kube-api-access-fhhpl\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:06.881539 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.881501 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hx55\" (UniqueName: \"kubernetes.io/projected/f473bc1e-0c7a-4952-8b17-1e0a63c0144e-kube-api-access-8hx55\") pod \"iptables-alerter-xwbq6\" (UID: \"f473bc1e-0c7a-4952-8b17-1e0a63c0144e\") " pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:06.897723 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.897671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" event={"ID":"7bbefd012d364337eca5b8c7e595d372","Type":"ContainerStarted","Data":"730d79ae835361be427cebbdde71da5cf28b0adc5e0b62f2d9612149a8f2eb6a"} Jul 15 16:37:06.967213 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.967213 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-socket-dir-parent\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-daemon-config\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-sys-fs\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-os-release\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967311 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh26x\" (UniqueName: \"kubernetes.io/projected/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-kube-api-access-qh26x\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967353 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-socket-dir-parent\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967377 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-sys-fs\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-os-release\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-hostroot\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-system-cni-dir\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-os-release\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-socket-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-system-cni-dir\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cni-binary-copy\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkbn9\" (UniqueName: \"kubernetes.io/projected/df14dead-eee8-4fc4-8e75-e7bebb67aeec-kube-api-access-gkbn9\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967647 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-os-release\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b7e6012-1e83-42e3-a85d-abb838b5661f-host\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b7e6012-1e83-42e3-a85d-abb838b5661f-serviceca\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967689 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-hostroot\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967706 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-cnibin\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-cni-binary-copy\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-netns\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.967790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-multus-certs\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967814 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-daemon-config\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967818 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmjwc\" (UniqueName: \"kubernetes.io/projected/49998592-3f25-4036-9b66-0152e6e6a96e-kube-api-access-kmjwc\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2twk\" (UniqueName: \"kubernetes.io/projected/1b7e6012-1e83-42e3-a85d-abb838b5661f-kube-api-access-q2twk\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-kubelet\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967925 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-etc-kubernetes\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.967976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-tmp-dir\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-cni-multus\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-device-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-conf-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968099 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-cnibin\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-hosts-file\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968128 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968129 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b7e6012-1e83-42e3-a85d-abb838b5661f-serviceca\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-cni-bin\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.968570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968171 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-multus-certs\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-registration-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968188 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-cni-bin\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968205 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b7e6012-1e83-42e3-a85d-abb838b5661f-host\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cnibin\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968251 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-netns\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968309 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-registration-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-socket-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968367 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-device-dir\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968408 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-conf-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968442 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cni-binary-copy\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968447 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-cnibin\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968487 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-hosts-file\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968516 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-kubelet\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-system-cni-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-system-cni-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdkxj\" (UniqueName: \"kubernetes.io/projected/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-kube-api-access-mdkxj\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.969265 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-cni-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968613 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49998592-3f25-4036-9b66-0152e6e6a96e-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968617 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-var-lib-cni-multus\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-k8s-cni-cncf-io\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968803 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df14dead-eee8-4fc4-8e75-e7bebb67aeec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-tmp-dir\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968845 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-cni-binary-copy\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968663 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-etc-kubernetes\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968852 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-multus-cni-dir\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.969922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.968879 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-host-run-k8s-cni-cncf-io\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.978486 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.978461 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh26x\" (UniqueName: \"kubernetes.io/projected/8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4-kube-api-access-qh26x\") pod \"node-resolver-9q65d\" (UID: \"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4\") " pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:06.978617 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.978490 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkbn9\" (UniqueName: \"kubernetes.io/projected/df14dead-eee8-4fc4-8e75-e7bebb67aeec-kube-api-access-gkbn9\") pod \"multus-additional-cni-plugins-8pmdx\" (UID: \"df14dead-eee8-4fc4-8e75-e7bebb67aeec\") " pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:06.978874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.978853 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2twk\" (UniqueName: \"kubernetes.io/projected/1b7e6012-1e83-42e3-a85d-abb838b5661f-kube-api-access-q2twk\") pod \"node-ca-w9czq\" (UID: \"1b7e6012-1e83-42e3-a85d-abb838b5661f\") " pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:06.979262 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.979239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdkxj\" (UniqueName: \"kubernetes.io/projected/d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f-kube-api-access-mdkxj\") pod \"multus-7cc7c\" (UID: \"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f\") " pod="openshift-multus/multus-7cc7c" Jul 15 16:37:06.979558 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:06.979541 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmjwc\" (UniqueName: \"kubernetes.io/projected/49998592-3f25-4036-9b66-0152e6e6a96e-kube-api-access-kmjwc\") pod \"aws-ebs-csi-driver-node-m7nlc\" (UID: \"49998592-3f25-4036-9b66-0152e6e6a96e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:07.047570 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.047532 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:07.059641 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.059610 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b615616_22a1_4167_bd7e_404c257160b4.slice/crio-c35f33dc5ecff21a2203e490b970a01cbb9403c3457a28b3289702f2f0ffdbee WatchSource:0}: Error finding container c35f33dc5ecff21a2203e490b970a01cbb9403c3457a28b3289702f2f0ffdbee: Status 404 returned error can't find the container with id c35f33dc5ecff21a2203e490b970a01cbb9403c3457a28b3289702f2f0ffdbee Jul 15 16:37:07.060394 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.060328 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwbq6" Jul 15 16:37:07.068960 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.068938 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf473bc1e_0c7a_4952_8b17_1e0a63c0144e.slice/crio-2fa5e45ac6ce1e7e77e4c622fe77eb2829c890f82fb0533a537dfb920dfb0f3c WatchSource:0}: Error finding container 2fa5e45ac6ce1e7e77e4c622fe77eb2829c890f82fb0533a537dfb920dfb0f3c: Status 404 returned error can't find the container with id 2fa5e45ac6ce1e7e77e4c622fe77eb2829c890f82fb0533a537dfb920dfb0f3c Jul 15 16:37:07.070894 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.070877 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" Jul 15 16:37:07.077900 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.077883 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:07.079172 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.079152 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7341943_babd_4728_9e31_3c55b132e63e.slice/crio-eb8ab7bbebe8906381c57034563baf7b2da5f875142069a842f2b802588b495d WatchSource:0}: Error finding container eb8ab7bbebe8906381c57034563baf7b2da5f875142069a842f2b802588b495d: Status 404 returned error can't find the container with id eb8ab7bbebe8906381c57034563baf7b2da5f875142069a842f2b802588b495d Jul 15 16:37:07.084221 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.084204 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9q65d" Jul 15 16:37:07.089934 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.089916 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w9czq" Jul 15 16:37:07.095392 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.095349 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7cc7c" Jul 15 16:37:07.100850 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.100833 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" Jul 15 16:37:07.105396 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.105379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" Jul 15 16:37:07.223892 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.223857 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 16:37:07.371820 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.371736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:07.371820 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.371804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:07.372062 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.371917 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:07.372062 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.371920 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:07.372062 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.371988 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret podName:373f1b76-aa65-4f5c-a05e-77de22119a3d nodeName:}" failed. No retries permitted until 2026-07-15 16:37:08.371969211 +0000 UTC m=+4.056218417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret") pod "global-pull-secret-syncer-vkt8f" (UID: "373f1b76-aa65-4f5c-a05e-77de22119a3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:07.372062 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.372008 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:08.371998142 +0000 UTC m=+4.056247349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:07.472682 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.472646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:07.472891 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.472831 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:37:07.472891 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.472855 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:37:07.472891 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.472865 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2l274 for pod openshift-network-diagnostics/network-check-target-bzr9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:07.473061 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:07.472927 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274 podName:43b0ce4a-0960-4747-a0c5-c4e958daf1d8 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:08.472908315 +0000 UTC m=+4.157157519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l274" (UniqueName: "kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274") pod "network-check-target-bzr9b" (UID: "43b0ce4a-0960-4747-a0c5-c4e958daf1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:07.729036 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.728984 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7e6012_1e83_42e3_a85d_abb838b5661f.slice/crio-62d5deece9a538890e99cf9267f5aa9faee6eda257e4efb394d6b3090fe2c5da WatchSource:0}: Error finding container 62d5deece9a538890e99cf9267f5aa9faee6eda257e4efb394d6b3090fe2c5da: Status 404 returned error can't find the container with id 62d5deece9a538890e99cf9267f5aa9faee6eda257e4efb394d6b3090fe2c5da Jul 15 16:37:07.729648 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.729617 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a45789b_c3c4_4910_8388_8ee23bf1d4af.slice/crio-be692f1bb6b65deace68772ae486d0df4a99c6e715f63f45767045d0a0a6c110 WatchSource:0}: Error finding container be692f1bb6b65deace68772ae486d0df4a99c6e715f63f45767045d0a0a6c110: Status 404 returned error can't find the container with id be692f1bb6b65deace68772ae486d0df4a99c6e715f63f45767045d0a0a6c110 Jul 15 16:37:07.732827 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.732794 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf14dead_eee8_4fc4_8e75_e7bebb67aeec.slice/crio-6ef3eeacbbcc619388f3a89dc108400a7124af5dcde9034ea2441d1533e43ac2 WatchSource:0}: Error finding container 6ef3eeacbbcc619388f3a89dc108400a7124af5dcde9034ea2441d1533e43ac2: Status 404 returned error can't find the container with id 6ef3eeacbbcc619388f3a89dc108400a7124af5dcde9034ea2441d1533e43ac2 Jul 15 16:37:07.733662 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.733639 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5ab3dc_0270_4329_9cd3_cc883bcbd5b4.slice/crio-d30c7905f01775019ccd6afdaee2925b6a4b92a1cb4229c1de3a2fe4d0c5a0e9 WatchSource:0}: Error finding container d30c7905f01775019ccd6afdaee2925b6a4b92a1cb4229c1de3a2fe4d0c5a0e9: Status 404 returned error can't find the container with id d30c7905f01775019ccd6afdaee2925b6a4b92a1cb4229c1de3a2fe4d0c5a0e9 Jul 15 16:37:07.736806 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.736750 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49998592_3f25_4036_9b66_0152e6e6a96e.slice/crio-138d504648bc9b2db120927569a7034d5fdb09ab599ca09866185092387d9cf0 WatchSource:0}: Error finding container 138d504648bc9b2db120927569a7034d5fdb09ab599ca09866185092387d9cf0: Status 404 returned error can't find the container with id 138d504648bc9b2db120927569a7034d5fdb09ab599ca09866185092387d9cf0 Jul 15 16:37:07.780159 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:07.780128 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf63cb8e054077d4c45fc3d59353744c.slice/crio-8b0aa03ccd2198374dec8698391237b0c84c7bd3e916793c23fe579f9272b349 WatchSource:0}: Error finding container 8b0aa03ccd2198374dec8698391237b0c84c7bd3e916793c23fe579f9272b349: Status 404 returned error can't find the container with id 8b0aa03ccd2198374dec8698391237b0c84c7bd3e916793c23fe579f9272b349 Jul 15 16:37:07.785475 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.785424 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:32:06 +0000 UTC" deadline="2028-01-10 07:10:56.062846414 +0000 UTC" Jul 15 16:37:07.785475 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.785474 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13046h33m48.277376631s" Jul 15 16:37:07.901205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.901160 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" event={"ID":"af63cb8e054077d4c45fc3d59353744c","Type":"ContainerStarted","Data":"8b0aa03ccd2198374dec8698391237b0c84c7bd3e916793c23fe579f9272b349"} Jul 15 16:37:07.902405 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.902362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9q65d" event={"ID":"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4","Type":"ContainerStarted","Data":"d30c7905f01775019ccd6afdaee2925b6a4b92a1cb4229c1de3a2fe4d0c5a0e9"} Jul 15 16:37:07.903691 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.903615 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"be692f1bb6b65deace68772ae486d0df4a99c6e715f63f45767045d0a0a6c110"} Jul 15 16:37:07.904918 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.904881 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w9czq" event={"ID":"1b7e6012-1e83-42e3-a85d-abb838b5661f","Type":"ContainerStarted","Data":"62d5deece9a538890e99cf9267f5aa9faee6eda257e4efb394d6b3090fe2c5da"} Jul 15 16:37:07.906045 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.906001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" event={"ID":"f7341943-babd-4728-9e31-3c55b132e63e","Type":"ContainerStarted","Data":"eb8ab7bbebe8906381c57034563baf7b2da5f875142069a842f2b802588b495d"} Jul 15 16:37:07.907164 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.907141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkl2m" event={"ID":"3b615616-22a1-4167-bd7e-404c257160b4","Type":"ContainerStarted","Data":"c35f33dc5ecff21a2203e490b970a01cbb9403c3457a28b3289702f2f0ffdbee"} Jul 15 16:37:07.909293 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.909269 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" event={"ID":"7bbefd012d364337eca5b8c7e595d372","Type":"ContainerStarted","Data":"9c242b4f461e6a02017df0436b5494dfc5df2ecfc65ab25a98a3620b1e200566"} Jul 15 16:37:07.910564 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.910530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" event={"ID":"49998592-3f25-4036-9b66-0152e6e6a96e","Type":"ContainerStarted","Data":"138d504648bc9b2db120927569a7034d5fdb09ab599ca09866185092387d9cf0"} Jul 15 16:37:07.911935 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.911910 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7cc7c" event={"ID":"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f","Type":"ContainerStarted","Data":"ebc6537069c7a37c5aea4e1fa86704b01b03567a50705d831992a9aab70b474a"} Jul 15 16:37:07.913160 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.913133 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerStarted","Data":"6ef3eeacbbcc619388f3a89dc108400a7124af5dcde9034ea2441d1533e43ac2"} Jul 15 16:37:07.914324 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.914298 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwbq6" event={"ID":"f473bc1e-0c7a-4952-8b17-1e0a63c0144e","Type":"ContainerStarted","Data":"2fa5e45ac6ce1e7e77e4c622fe77eb2829c890f82fb0533a537dfb920dfb0f3c"} Jul 15 16:37:07.925395 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:07.925346 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-145.ec2.internal" podStartSLOduration=1.9253292869999998 podStartE2EDuration="1.925329287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:07.924643246 +0000 UTC m=+3.608892465" watchObservedRunningTime="2026-07-15 16:37:07.925329287 +0000 UTC m=+3.609578514" Jul 15 16:37:08.380213 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.379883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:08.380385 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.380235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:08.380385 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.380375 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:08.380495 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.380442 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:10.380421077 +0000 UTC m=+6.064670304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:08.380867 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.380850 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:08.380953 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.380904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret podName:373f1b76-aa65-4f5c-a05e-77de22119a3d nodeName:}" failed. No retries permitted until 2026-07-15 16:37:10.380889108 +0000 UTC m=+6.065138316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret") pod "global-pull-secret-syncer-vkt8f" (UID: "373f1b76-aa65-4f5c-a05e-77de22119a3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:08.481632 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.481592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:08.481833 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.481817 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:37:08.481901 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.481842 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:37:08.481901 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.481854 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2l274 for pod openshift-network-diagnostics/network-check-target-bzr9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:08.482008 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.481918 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274 podName:43b0ce4a-0960-4747-a0c5-c4e958daf1d8 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:10.48189812 +0000 UTC m=+6.166147344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l274" (UniqueName: "kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274") pod "network-check-target-bzr9b" (UID: "43b0ce4a-0960-4747-a0c5-c4e958daf1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:08.786380 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.786284 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:32:06 +0000 UTC" deadline="2028-01-26 13:37:55.260791473 +0000 UTC" Jul 15 16:37:08.786380 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.786326 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13437h0m46.474469303s" Jul 15 16:37:08.895941 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.895906 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:08.896117 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.896069 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:08.896475 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.896453 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:08.896575 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.896552 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:08.896658 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:08.896618 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:08.896717 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:08.896701 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:10.398256 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:10.397419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:10.398256 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:10.397493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:10.398256 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.397657 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:10.398256 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.397720 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:14.397700679 +0000 UTC m=+10.081949886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:10.398256 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.398140 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:10.398256 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.398193 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret podName:373f1b76-aa65-4f5c-a05e-77de22119a3d nodeName:}" failed. No retries permitted until 2026-07-15 16:37:14.398178302 +0000 UTC m=+10.082427510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret") pod "global-pull-secret-syncer-vkt8f" (UID: "373f1b76-aa65-4f5c-a05e-77de22119a3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:10.498211 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:10.498179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:10.498470 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.498447 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:37:10.498574 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.498476 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:37:10.498574 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.498489 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2l274 for pod openshift-network-diagnostics/network-check-target-bzr9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:10.498574 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.498552 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274 podName:43b0ce4a-0960-4747-a0c5-c4e958daf1d8 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:14.498532987 +0000 UTC m=+10.182782193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l274" (UniqueName: "kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274") pod "network-check-target-bzr9b" (UID: "43b0ce4a-0960-4747-a0c5-c4e958daf1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:10.893250 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:10.893165 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:10.893409 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.893295 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:10.894102 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:10.894062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:10.894216 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.894180 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:10.894276 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:10.894248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:10.894338 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:10.894318 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:12.893762 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:12.893723 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:12.893762 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:12.893757 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:12.894309 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:12.893865 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:12.894309 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:12.893899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:12.894309 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:12.893993 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:12.894309 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:12.894113 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:14.435910 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:14.435851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:14.436366 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:14.436027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:14.436366 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.436040 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:14.436366 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.436122 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret podName:373f1b76-aa65-4f5c-a05e-77de22119a3d nodeName:}" failed. No retries permitted until 2026-07-15 16:37:22.436100249 +0000 UTC m=+18.120349466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret") pod "global-pull-secret-syncer-vkt8f" (UID: "373f1b76-aa65-4f5c-a05e-77de22119a3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:14.436366 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.436157 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:14.436366 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.436218 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:22.43620059 +0000 UTC m=+18.120449813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:14.537166 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:14.537118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:14.537339 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.537310 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:37:14.537339 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.537329 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:37:14.537457 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.537341 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2l274 for pod openshift-network-diagnostics/network-check-target-bzr9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:14.537457 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.537405 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274 podName:43b0ce4a-0960-4747-a0c5-c4e958daf1d8 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:22.537386144 +0000 UTC m=+18.221635354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l274" (UniqueName: "kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274") pod "network-check-target-bzr9b" (UID: "43b0ce4a-0960-4747-a0c5-c4e958daf1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:14.894710 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:14.894623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:14.894872 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.894759 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:14.895504 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:14.895222 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:14.895504 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.895338 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:14.895504 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:14.895386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:14.895504 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:14.895452 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:16.893488 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:16.893452 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:16.893938 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:16.893585 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:16.893938 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:16.893453 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:16.893938 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:16.893694 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:16.893938 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:16.893452 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:16.893938 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:16.893765 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:18.893619 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:18.893578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:18.894096 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:18.893578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:18.894096 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:18.893706 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:18.894096 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:18.893598 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:18.894096 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:18.893804 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:18.894096 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:18.893866 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:20.893369 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:20.893321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:20.893369 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:20.893370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:20.893936 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:20.893321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:20.893936 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:20.893456 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:20.893936 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:20.893586 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:20.893936 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:20.893694 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:22.496528 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:22.496488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:22.496528 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:22.496545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:22.497085 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.496662 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:22.497085 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.496665 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:22.497085 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.496716 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:38.496702058 +0000 UTC m=+34.180951262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:22.497085 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.496728 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret podName:373f1b76-aa65-4f5c-a05e-77de22119a3d nodeName:}" failed. No retries permitted until 2026-07-15 16:37:38.496722696 +0000 UTC m=+34.180971900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret") pod "global-pull-secret-syncer-vkt8f" (UID: "373f1b76-aa65-4f5c-a05e-77de22119a3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:22.597532 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:22.597496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:22.597668 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.597627 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:37:22.597668 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.597641 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:37:22.597668 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.597649 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2l274 for pod openshift-network-diagnostics/network-check-target-bzr9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:22.597751 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.597700 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274 podName:43b0ce4a-0960-4747-a0c5-c4e958daf1d8 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:38.597687351 +0000 UTC m=+34.281936555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l274" (UniqueName: "kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274") pod "network-check-target-bzr9b" (UID: "43b0ce4a-0960-4747-a0c5-c4e958daf1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:22.893495 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:22.893406 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:22.893648 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:22.893406 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:22.893648 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:22.893557 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:22.893648 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.893551 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:22.893803 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.893685 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:22.893803 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:22.893770 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:24.894287 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:24.894254 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:24.894692 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:24.894366 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:24.894692 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:24.894408 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:24.894692 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:24.894549 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:24.894692 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:24.894584 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:24.894692 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:24.894667 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:26.893627 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:26.893366 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:26.893627 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:26.893372 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:26.893627 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:26.893489 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:26.893627 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:26.893501 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:26.893627 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:26.893588 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:26.894238 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:26.893665 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:26.990653 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:26.990332 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" event={"ID":"f7341943-babd-4728-9e31-3c55b132e63e","Type":"ContainerStarted","Data":"f858899d3f311a0df4c75a63b0bedb35099c3986638022991888d6a5d6aafa17"} Jul 15 16:37:27.010588 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:27.010537 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j4vkq" podStartSLOduration=2.25450286 podStartE2EDuration="22.010517118s" totalImagesPullingTime="19.756014258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:27.009779782 +0000 UTC m=+22.694029011" watchObservedRunningTime="2026-07-15 16:37:27.010517118 +0000 UTC m=+22.694766347" Jul 15 16:37:27.994544 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:27.994322 2565 generic.go:356] "Generic (PLEG): container finished" podID="af63cb8e054077d4c45fc3d59353744c" containerID="5a612da41e8e99d1970198784acbb3c1750376836dd6025bd2eccf1a25017db1" exitCode=0 Jul 15 16:37:27.995433 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:27.994399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" event={"ID":"af63cb8e054077d4c45fc3d59353744c","Type":"ContainerDied","Data":"5a612da41e8e99d1970198784acbb3c1750376836dd6025bd2eccf1a25017db1"} Jul 15 16:37:27.996791 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:27.996763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9q65d" event={"ID":"8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4","Type":"ContainerStarted","Data":"3558822ec60aee75b04d08fb7c81f7f2fa0a60c442d70b9dca4ff40d51723f0d"} Jul 15 16:37:28.000193 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000171 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:37:28.000550 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000525 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a45789b-c3c4-4910-8388-8ee23bf1d4af" containerID="ff2d3d20f11c8f921f9e272f728b206880f263e9963cbd1375f19cb522c76c3d" exitCode=1 Jul 15 16:37:28.000659 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000594 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"c0592ee3614bedd0194bece47588444901a1e628b01689fc839ee7341958c16a"} Jul 15 16:37:28.000725 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000665 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"748bd820dd71635a10b88dbb96b62f3124254dbfdbef1b419ca29495d3a9a542"} Jul 15 16:37:28.000725 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"b5b4a37d40eb928675d20a439b79123ecd2df34b7286aef602b2c92fd200df86"} Jul 15 16:37:28.000834 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"fb2b233cfc7984b5cb8832138aec6cce67deacc3eb6def44aec59686337b7fd4"} Jul 15 16:37:28.000834 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerDied","Data":"ff2d3d20f11c8f921f9e272f728b206880f263e9963cbd1375f19cb522c76c3d"} Jul 15 16:37:28.000918 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.000859 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"45e8ffd9e685cc8baf15097eac8b479fd7e953b3e141bd0527d0debf59633b31"} Jul 15 16:37:28.002226 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.002206 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w9czq" event={"ID":"1b7e6012-1e83-42e3-a85d-abb838b5661f","Type":"ContainerStarted","Data":"be3e5fcf543393a97d272c2fca608304b490abcfab6bd226bdc26aaa5677441a"} Jul 15 16:37:28.003687 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.003660 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkl2m" event={"ID":"3b615616-22a1-4167-bd7e-404c257160b4","Type":"ContainerStarted","Data":"e91cca27c44a9f57923f83c62085d9921234c8000f5308d2f594381e9edcd3c7"} Jul 15 16:37:28.005169 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.005150 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" event={"ID":"49998592-3f25-4036-9b66-0152e6e6a96e","Type":"ContainerStarted","Data":"05dfe946ad176efd07c3feee74fd18b4a205666a7c1b786899cc5349bbaa4a55"} Jul 15 16:37:28.006737 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.006716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7cc7c" event={"ID":"d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f","Type":"ContainerStarted","Data":"5844a83153681a2164f7f23d53e57204e564503201f0e75745cf9e78ff76ed6c"} Jul 15 16:37:28.008480 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.008454 2565 generic.go:356] "Generic (PLEG): container finished" podID="df14dead-eee8-4fc4-8e75-e7bebb67aeec" containerID="fd6285e0ba096bdd3f10973d4cfdcc1b2f17d40e7d702c4341aa6f7f59f025c1" exitCode=0 Jul 15 16:37:28.008587 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.008522 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerDied","Data":"fd6285e0ba096bdd3f10973d4cfdcc1b2f17d40e7d702c4341aa6f7f59f025c1"} Jul 15 16:37:28.026301 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.026250 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9q65d" podStartSLOduration=3.93156673 podStartE2EDuration="23.026229625s" totalImagesPullingTime="19.094662895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:28.025908179 +0000 UTC m=+23.710157409" watchObservedRunningTime="2026-07-15 16:37:28.026229625 +0000 UTC m=+23.710478852" Jul 15 16:37:28.044979 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.044920 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w9czq" podStartSLOduration=3.937055271 podStartE2EDuration="23.044902146s" totalImagesPullingTime="19.107846875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:28.04473155 +0000 UTC m=+23.728980776" watchObservedRunningTime="2026-07-15 16:37:28.044902146 +0000 UTC m=+23.729151374" Jul 15 16:37:28.090153 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.090105 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mkl2m" podStartSLOduration=4.311867333 podStartE2EDuration="24.090088311s" totalImagesPullingTime="19.778220978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:28.061012604 +0000 UTC m=+23.745278847" watchObservedRunningTime="2026-07-15 16:37:28.090088311 +0000 UTC m=+23.774337536" Jul 15 16:37:28.090344 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.090324 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7cc7c" podStartSLOduration=3.939463418 podStartE2EDuration="23.090319287s" totalImagesPullingTime="19.150855869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:28.08958394 +0000 UTC m=+23.773833166" watchObservedRunningTime="2026-07-15 16:37:28.090319287 +0000 UTC m=+23.774568513" Jul 15 16:37:28.435709 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.435680 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 16:37:28.821861 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.821704 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T16:37:28.435703687Z","UUID":"83b3452f-d93e-4724-81bf-78a1aeee21ce","Handler":null,"Name":"","Endpoint":""} Jul 15 16:37:28.823508 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.823487 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 16:37:28.823627 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.823526 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 16:37:28.893982 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.893937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:28.893982 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.893961 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:28.894215 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:28.893937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:28.894215 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:28.894081 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:28.894215 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:28.894200 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:28.894314 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:28.894278 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:29.013342 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:29.013300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwbq6" event={"ID":"f473bc1e-0c7a-4952-8b17-1e0a63c0144e","Type":"ContainerStarted","Data":"f21352b132e0bbeb04fe4e71eb446d0a4b8276616f657d4225afcd9ff2533f81"} Jul 15 16:37:29.015641 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:29.015593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" event={"ID":"af63cb8e054077d4c45fc3d59353744c","Type":"ContainerStarted","Data":"c423dafb7372170c7554114d58d46f966a39e63fb5edb9c23fe89cea66b43da1"} Jul 15 16:37:29.017909 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:29.017871 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" event={"ID":"49998592-3f25-4036-9b66-0152e6e6a96e","Type":"ContainerStarted","Data":"5fa2da1bb681de94e5be6dac5473ec7c7b97ff027e28335e3bacbb2e10aeea1c"} Jul 15 16:37:29.029323 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:29.029271 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xwbq6" podStartSLOduration=5.268972293 podStartE2EDuration="25.029255436s" totalImagesPullingTime="19.760283143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:29.028676482 +0000 UTC m=+24.712925708" watchObservedRunningTime="2026-07-15 16:37:29.029255436 +0000 UTC m=+24.713504662" Jul 15 16:37:29.044328 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:29.044265 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-145.ec2.internal" podStartSLOduration=23.044247371 podStartE2EDuration="23.044247371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:29.043941665 +0000 UTC m=+24.728190892" watchObservedRunningTime="2026-07-15 16:37:29.044247371 +0000 UTC m=+24.728496596" Jul 15 16:37:30.024432 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:30.024352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:37:30.024927 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:30.024836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"29459304e51f3b519da75cdc2d1ad3e5b8408464f3881ede48352b114d3c25c4"} Jul 15 16:37:30.893688 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:30.893656 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:30.893688 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:30.893678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:30.893946 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:30.893665 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:30.893946 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:30.893794 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:30.893946 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:30.893860 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:30.893946 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:30.893908 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:32.893222 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:32.893031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:32.893660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:32.893031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:32.893660 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:32.893307 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:32.893660 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:32.893078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:32.893660 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:32.893371 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:32.893660 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:32.893462 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:32.945850 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:32.945812 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:32.946462 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:32.946440 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:33.032283 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:33.032249 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:33.032736 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:33.032718 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mkl2m" Jul 15 16:37:34.036874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.036634 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" event={"ID":"49998592-3f25-4036-9b66-0152e6e6a96e","Type":"ContainerStarted","Data":"fd030b9da36754c37085d9323fc43183ab84cf32b24af48767bab4ddfa4b552a"} Jul 15 16:37:34.038389 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.038363 2565 generic.go:356] "Generic (PLEG): container finished" podID="df14dead-eee8-4fc4-8e75-e7bebb67aeec" containerID="e86d6e849cc3eaf6670801e8f7bb79ab790d9c59b897165249f6ca21afefd30f" exitCode=0 Jul 15 16:37:34.038506 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.038446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerDied","Data":"e86d6e849cc3eaf6670801e8f7bb79ab790d9c59b897165249f6ca21afefd30f"} Jul 15 16:37:34.041806 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.041789 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:37:34.042250 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.042233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"4663afc58b9fdb37fde271213ce3e0960379b0106188995652d38dc74ca7ce43"} Jul 15 16:37:34.042448 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.042433 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:34.042548 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.042534 2565 scope.go:117] "RemoveContainer" containerID="ff2d3d20f11c8f921f9e272f728b206880f263e9963cbd1375f19cb522c76c3d" Jul 15 16:37:34.056317 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.056273 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7nlc" podStartSLOduration=4.226466251 podStartE2EDuration="29.056257205s" totalImagesPullingTime="24.829790954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:34.055764808 +0000 UTC m=+29.740014033" watchObservedRunningTime="2026-07-15 16:37:34.056257205 +0000 UTC m=+29.740506432" Jul 15 16:37:34.059494 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.059473 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:34.895393 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.895300 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:34.895611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.895410 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:34.895611 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:34.895457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:34.895611 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:34.895476 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:34.895611 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:34.895544 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:34.895832 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:34.895624 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:35.049644 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.049609 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:37:35.050234 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.050047 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" event={"ID":"5a45789b-c3c4-4910-8388-8ee23bf1d4af","Type":"ContainerStarted","Data":"19b532a75a5566a452b8232b9d6b3488fe979366d28185f8694747393f8315d7"} Jul 15 16:37:35.050234 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.050160 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 16:37:35.050927 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.050389 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:35.068470 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.068437 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:35.115800 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.115745 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" podStartSLOduration=10.936936059 podStartE2EDuration="30.115728053s" totalImagesPullingTime="19.178791994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:35.086686952 +0000 UTC m=+30.770936178" watchObservedRunningTime="2026-07-15 16:37:35.115728053 +0000 UTC m=+30.799977278" Jul 15 16:37:35.139362 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.139324 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vkt8f"] Jul 15 16:37:35.139539 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.139519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:35.139667 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:35.139644 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:35.142672 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.142638 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s7b8h"] Jul 15 16:37:35.142805 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.142762 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:35.142892 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:35.142868 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:35.143363 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.143338 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzr9b"] Jul 15 16:37:35.143466 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:35.143451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:35.143542 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:35.143523 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:36.056250 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:36.056211 2565 generic.go:356] "Generic (PLEG): container finished" podID="df14dead-eee8-4fc4-8e75-e7bebb67aeec" containerID="073c0fe7b5f622658ba294cf82d6fc670cfa78727f253803248ac54b6c4c3e03" exitCode=0 Jul 15 16:37:36.056671 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:36.056294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerDied","Data":"073c0fe7b5f622658ba294cf82d6fc670cfa78727f253803248ac54b6c4c3e03"} Jul 15 16:37:36.056671 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:36.056502 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 16:37:36.893488 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:36.893457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:36.893488 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:36.893480 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:36.893697 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:36.893457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:36.893697 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:36.893561 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:36.893697 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:36.893631 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:36.893823 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:36.893740 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:36.980011 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:36.979815 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:37.062199 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:37.062162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerStarted","Data":"0a9b4759ab65ef3c9fa00c657a98ad3f30cbd454de196bfd4da0f646906a3eee"} Jul 15 16:37:38.067033 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.066923 2565 generic.go:356] "Generic (PLEG): container finished" podID="df14dead-eee8-4fc4-8e75-e7bebb67aeec" containerID="0a9b4759ab65ef3c9fa00c657a98ad3f30cbd454de196bfd4da0f646906a3eee" exitCode=0 Jul 15 16:37:38.067472 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.067061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerDied","Data":"0a9b4759ab65ef3c9fa00c657a98ad3f30cbd454de196bfd4da0f646906a3eee"} Jul 15 16:37:38.081851 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.081827 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d858" Jul 15 16:37:38.516820 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.516778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:38.517012 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.516865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:38.517012 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.516925 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:38.517012 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.516966 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:38.517012 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.516988 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret podName:373f1b76-aa65-4f5c-a05e-77de22119a3d nodeName:}" failed. No retries permitted until 2026-07-15 16:38:10.516973816 +0000 UTC m=+66.201223020 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret") pod "global-pull-secret-syncer-vkt8f" (UID: "373f1b76-aa65-4f5c-a05e-77de22119a3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 16:37:38.517163 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.517074 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:10.517057916 +0000 UTC m=+66.201307134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 16:37:38.618136 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.618082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:38.618302 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.618237 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 16:37:38.618302 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.618256 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 16:37:38.618302 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.618266 2565 projected.go:196] Error preparing data for projected volume kube-api-access-2l274 for pod openshift-network-diagnostics/network-check-target-bzr9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:38.618419 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.618321 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274 podName:43b0ce4a-0960-4747-a0c5-c4e958daf1d8 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:10.618304395 +0000 UTC m=+66.302553605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l274" (UniqueName: "kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274") pod "network-check-target-bzr9b" (UID: "43b0ce4a-0960-4747-a0c5-c4e958daf1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 16:37:38.898721 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.898632 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:38.898874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.898731 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:38.898874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:38.898756 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:38.898874 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.898746 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzr9b" podUID="43b0ce4a-0960-4747-a0c5-c4e958daf1d8" Jul 15 16:37:38.898874 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.898846 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7b8h" podUID="e7440086-cac0-41f4-87d0-5f42a2e670d2" Jul 15 16:37:38.899124 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:38.898915 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vkt8f" podUID="373f1b76-aa65-4f5c-a05e-77de22119a3d" Jul 15 16:37:39.589338 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.589304 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-145.ec2.internal" event="NodeReady" Jul 15 16:37:39.589754 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.589441 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 16:37:39.665182 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.665105 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wrl48"] Jul 15 16:37:39.668314 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.668281 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8d5nb"] Jul 15 16:37:39.668472 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.668420 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.671348 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.671322 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:39.671348 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.671346 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 16:37:39.671941 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.671915 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hj6qd\"" Jul 15 16:37:39.672055 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.671922 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 16:37:39.674922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.674781 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 16:37:39.674922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.674795 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 16:37:39.674922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.674824 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tqn7q\"" Jul 15 16:37:39.674922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.674923 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 16:37:39.679988 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.679969 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8d5nb"] Jul 15 16:37:39.685209 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.684421 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wrl48"] Jul 15 16:37:39.826181 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.826150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261fea66-f664-4622-93ce-2e5bfcf6d5b4-config-volume\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.826375 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.826203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.826375 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.826230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261fea66-f664-4622-93ce-2e5bfcf6d5b4-tmp-dir\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.826375 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.826278 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86g2z\" (UniqueName: \"kubernetes.io/projected/261fea66-f664-4622-93ce-2e5bfcf6d5b4-kube-api-access-86g2z\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.826375 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.826302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mttzt\" (UniqueName: \"kubernetes.io/projected/57543dc7-126e-4692-ac17-a891fb0e71b2-kube-api-access-mttzt\") pod \"ingress-canary-8d5nb\" (UID: \"57543dc7-126e-4692-ac17-a891fb0e71b2\") " pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:39.826375 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.826335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57543dc7-126e-4692-ac17-a891fb0e71b2-cert\") pod \"ingress-canary-8d5nb\" (UID: \"57543dc7-126e-4692-ac17-a891fb0e71b2\") " pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:39.926822 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.926737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57543dc7-126e-4692-ac17-a891fb0e71b2-cert\") pod \"ingress-canary-8d5nb\" (UID: \"57543dc7-126e-4692-ac17-a891fb0e71b2\") " pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:39.926979 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.926853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261fea66-f664-4622-93ce-2e5bfcf6d5b4-config-volume\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.926979 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.926910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.926979 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.926947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261fea66-f664-4622-93ce-2e5bfcf6d5b4-tmp-dir\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.927167 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.927011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86g2z\" (UniqueName: \"kubernetes.io/projected/261fea66-f664-4622-93ce-2e5bfcf6d5b4-kube-api-access-86g2z\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.927167 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.927055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttzt\" (UniqueName: \"kubernetes.io/projected/57543dc7-126e-4692-ac17-a891fb0e71b2-kube-api-access-mttzt\") pod \"ingress-canary-8d5nb\" (UID: \"57543dc7-126e-4692-ac17-a891fb0e71b2\") " pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:39.927167 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:39.927087 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:37:39.927167 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:39.927159 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:40.427138577 +0000 UTC m=+36.111387786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:37:39.927381 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.927298 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261fea66-f664-4622-93ce-2e5bfcf6d5b4-tmp-dir\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.927453 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.927420 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261fea66-f664-4622-93ce-2e5bfcf6d5b4-config-volume\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.932446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.932422 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57543dc7-126e-4692-ac17-a891fb0e71b2-cert\") pod \"ingress-canary-8d5nb\" (UID: \"57543dc7-126e-4692-ac17-a891fb0e71b2\") " pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:39.939262 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.939235 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mttzt\" (UniqueName: \"kubernetes.io/projected/57543dc7-126e-4692-ac17-a891fb0e71b2-kube-api-access-mttzt\") pod \"ingress-canary-8d5nb\" (UID: \"57543dc7-126e-4692-ac17-a891fb0e71b2\") " pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:39.939391 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.939318 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86g2z\" (UniqueName: \"kubernetes.io/projected/261fea66-f664-4622-93ce-2e5bfcf6d5b4-kube-api-access-86g2z\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:39.988353 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:39.988321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8d5nb" Jul 15 16:37:40.145577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.145545 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8d5nb"] Jul 15 16:37:40.150031 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:37:40.149796 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57543dc7_126e_4692_ac17_a891fb0e71b2.slice/crio-1d2b0f6684671dae55d6221fd564db0a509583a38b79d92763edf380da61512a WatchSource:0}: Error finding container 1d2b0f6684671dae55d6221fd564db0a509583a38b79d92763edf380da61512a: Status 404 returned error can't find the container with id 1d2b0f6684671dae55d6221fd564db0a509583a38b79d92763edf380da61512a Jul 15 16:37:40.431834 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.431799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:40.432087 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:40.432065 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:37:40.432168 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:40.432138 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:41.432119072 +0000 UTC m=+37.116368276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:37:40.893954 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.893919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:37:40.894846 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.893919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:37:40.894846 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.893919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:37:40.897823 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.897803 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 16:37:40.897953 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.897852 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jvllt\"" Jul 15 16:37:40.897953 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.897804 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jfbzx\"" Jul 15 16:37:40.898106 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.897961 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 16:37:40.898106 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.897804 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 16:37:40.898233 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:40.898216 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 16:37:41.076557 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:41.076430 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8d5nb" event={"ID":"57543dc7-126e-4692-ac17-a891fb0e71b2","Type":"ContainerStarted","Data":"1d2b0f6684671dae55d6221fd564db0a509583a38b79d92763edf380da61512a"} Jul 15 16:37:41.440043 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:41.439948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:41.440185 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:41.440164 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:37:41.440240 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:41.440228 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:43.440206208 +0000 UTC m=+39.124455430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:37:43.458087 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:43.458048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:43.458551 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:43.458268 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:37:43.458551 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:43.458336 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:47.458315514 +0000 UTC m=+43.142564722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:37:45.087377 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:45.087337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8d5nb" event={"ID":"57543dc7-126e-4692-ac17-a891fb0e71b2","Type":"ContainerStarted","Data":"0246c626ec984df913eb2ff27d3493998fddf7b9e4ade3f4d118ac289d950ad5"} Jul 15 16:37:45.090102 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:45.090068 2565 generic.go:356] "Generic (PLEG): container finished" podID="df14dead-eee8-4fc4-8e75-e7bebb67aeec" containerID="f5118218acb07aa2366d88317cddfa2d152362dbf939ea3fd639a830ddc017a9" exitCode=0 Jul 15 16:37:45.090241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:45.090126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerDied","Data":"f5118218acb07aa2366d88317cddfa2d152362dbf939ea3fd639a830ddc017a9"} Jul 15 16:37:45.104686 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:45.104633 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8d5nb" podStartSLOduration=1.897101812 podStartE2EDuration="6.104618502s" totalImagesPullingTime="4.20751669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:45.104492542 +0000 UTC m=+40.788741780" watchObservedRunningTime="2026-07-15 16:37:45.104618502 +0000 UTC m=+40.788867710" Jul 15 16:37:46.095471 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:46.095436 2565 generic.go:356] "Generic (PLEG): container finished" podID="df14dead-eee8-4fc4-8e75-e7bebb67aeec" containerID="fb9cd6b528834823bde51101378aa6ac9900cde6bb35aa452cd1972fc76d67ca" exitCode=0 Jul 15 16:37:46.095849 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:46.095545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerDied","Data":"fb9cd6b528834823bde51101378aa6ac9900cde6bb35aa452cd1972fc76d67ca"} Jul 15 16:37:47.101413 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:47.101370 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" event={"ID":"df14dead-eee8-4fc4-8e75-e7bebb67aeec","Type":"ContainerStarted","Data":"616107691ed8d299d6765f8b4cd8bc940787f1b73a982844116e139cb5f648bd"} Jul 15 16:37:47.140139 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:47.138278 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8pmdx" podStartSLOduration=9.469361803 podStartE2EDuration="42.13825817s" totalImagesPullingTime="32.668896367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:37:47.137187261 +0000 UTC m=+42.821436487" watchObservedRunningTime="2026-07-15 16:37:47.13825817 +0000 UTC m=+42.822507397" Jul 15 16:37:47.488582 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:47.488547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:47.488738 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:47.488704 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:37:47.488790 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:47.488784 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:37:55.488767515 +0000 UTC m=+51.173016720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:37:55.542680 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:37:55.542633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:37:55.543150 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:55.542803 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:37:55.543150 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:37:55.542872 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:11.542855573 +0000 UTC m=+67.227104777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:38:10.549103 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.549049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:38:10.549731 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.549122 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:38:10.551427 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.551408 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 16:38:10.551502 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.551485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 16:38:10.559407 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:10.559387 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 16:38:10.559468 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:10.559449 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs podName:e7440086-cac0-41f4-87d0-5f42a2e670d2 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:14.5594311 +0000 UTC m=+130.243680303 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs") pod "network-metrics-daemon-s7b8h" (UID: "e7440086-cac0-41f4-87d0-5f42a2e670d2") : secret "metrics-daemon-secret" not found Jul 15 16:38:10.562853 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.562823 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/373f1b76-aa65-4f5c-a05e-77de22119a3d-original-pull-secret\") pod \"global-pull-secret-syncer-vkt8f\" (UID: \"373f1b76-aa65-4f5c-a05e-77de22119a3d\") " pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:38:10.615768 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.615727 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vkt8f" Jul 15 16:38:10.650232 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.650201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:38:10.653252 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.653235 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 16:38:10.662821 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.662797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 16:38:10.673343 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.673315 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l274\" (UniqueName: \"kubernetes.io/projected/43b0ce4a-0960-4747-a0c5-c4e958daf1d8-kube-api-access-2l274\") pod \"network-check-target-bzr9b\" (UID: \"43b0ce4a-0960-4747-a0c5-c4e958daf1d8\") " pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:38:10.743341 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.743309 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vkt8f"] Jul 15 16:38:10.746634 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:38:10.746602 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373f1b76_aa65_4f5c_a05e_77de22119a3d.slice/crio-69cb907cbbc488cc118e81d038106043f7966bae3d285adb90addd229a02afc2 WatchSource:0}: Error finding container 69cb907cbbc488cc118e81d038106043f7966bae3d285adb90addd229a02afc2: Status 404 returned error can't find the container with id 69cb907cbbc488cc118e81d038106043f7966bae3d285adb90addd229a02afc2 Jul 15 16:38:10.910262 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.910178 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jfbzx\"" Jul 15 16:38:10.918219 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:10.918203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:38:11.041817 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:11.041786 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzr9b"] Jul 15 16:38:11.044572 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:38:11.044543 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b0ce4a_0960_4747_a0c5_c4e958daf1d8.slice/crio-057aaf6ed9d49c3b9730e8768a895691bcec95aa70a22cefc2fc6cec71b82a2b WatchSource:0}: Error finding container 057aaf6ed9d49c3b9730e8768a895691bcec95aa70a22cefc2fc6cec71b82a2b: Status 404 returned error can't find the container with id 057aaf6ed9d49c3b9730e8768a895691bcec95aa70a22cefc2fc6cec71b82a2b Jul 15 16:38:11.154734 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:11.154699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzr9b" event={"ID":"43b0ce4a-0960-4747-a0c5-c4e958daf1d8","Type":"ContainerStarted","Data":"057aaf6ed9d49c3b9730e8768a895691bcec95aa70a22cefc2fc6cec71b82a2b"} Jul 15 16:38:11.155833 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:11.155805 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vkt8f" event={"ID":"373f1b76-aa65-4f5c-a05e-77de22119a3d","Type":"ContainerStarted","Data":"69cb907cbbc488cc118e81d038106043f7966bae3d285adb90addd229a02afc2"} Jul 15 16:38:11.554303 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:11.554269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:38:11.554745 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:11.554429 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:38:11.554745 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:11.554497 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:43.554480768 +0000 UTC m=+99.238729976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:38:16.171078 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:16.171037 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzr9b" event={"ID":"43b0ce4a-0960-4747-a0c5-c4e958daf1d8","Type":"ContainerStarted","Data":"569e0adf3a105b7aa91617404999d6685f6acf40567a018e0731ebb07268c5f6"} Jul 15 16:38:16.171663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:16.171221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:38:16.172440 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:16.172415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vkt8f" event={"ID":"373f1b76-aa65-4f5c-a05e-77de22119a3d","Type":"ContainerStarted","Data":"3318bcdd34a84b636f6d83663d400e04aa6a237ff3918af9f768772481fd449d"} Jul 15 16:38:16.191241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:16.191193 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bzr9b" podStartSLOduration=67.280323373 podStartE2EDuration="1m12.19117598s" totalImagesPullingTime="4.910852607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:38:16.190249573 +0000 UTC m=+71.874498799" watchObservedRunningTime="2026-07-15 16:38:16.19117598 +0000 UTC m=+71.875425207" Jul 15 16:38:16.208133 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:16.208042 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vkt8f" podStartSLOduration=66.000340687 podStartE2EDuration="1m11.208003616s" totalImagesPullingTime="5.207662929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:38:16.207344794 +0000 UTC m=+71.891594022" watchObservedRunningTime="2026-07-15 16:38:16.208003616 +0000 UTC m=+71.892252841" Jul 15 16:38:43.568839 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:43.568788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:38:43.569360 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:43.568912 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 16:38:43.569360 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:43.568979 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls podName:261fea66-f664-4622-93ce-2e5bfcf6d5b4 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:47.568965348 +0000 UTC m=+163.253214562 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls") pod "dns-default-wrl48" (UID: "261fea66-f664-4622-93ce-2e5bfcf6d5b4") : secret "dns-default-metrics-tls" not found Jul 15 16:38:47.178099 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:47.178070 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bzr9b" Jul 15 16:38:48.604478 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.604431 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq"] Jul 15 16:38:48.640281 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.640253 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-vwvwt"] Jul 15 16:38:48.640435 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.640377 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.646255 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.646226 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 16:38:48.646773 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.646687 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 16:38:48.647199 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.647172 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 16:38:48.647199 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.647189 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-w6nnc\"" Jul 15 16:38:48.647344 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.647209 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:38:48.653859 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.653838 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq"] Jul 15 16:38:48.653960 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.653866 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vwvwt"] Jul 15 16:38:48.653960 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.653947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.656971 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.656945 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 16:38:48.657101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.657036 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dm7xj\"" Jul 15 16:38:48.657546 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.657531 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 16:38:48.657855 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.657840 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:38:48.657937 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.657903 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 16:38:48.662604 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.662584 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 16:38:48.700904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.700864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c8e96-a074-4426-bb72-5d5aac6abc91-config\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.700904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.700904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bthff\" (UniqueName: \"kubernetes.io/projected/588c8e96-a074-4426-bb72-5d5aac6abc91-kube-api-access-bthff\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.701148 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.700932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/588c8e96-a074-4426-bb72-5d5aac6abc91-serving-cert\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.725316 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.725285 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-shtqb"] Jul 15 16:38:48.748492 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.748452 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c9cf75b96-8t5b9"] Jul 15 16:38:48.748492 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.748469 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:48.751091 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.751068 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v2sp4\"" Jul 15 16:38:48.753647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.753623 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 16:38:48.756835 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.756805 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 16:38:48.772114 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.772096 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-shtqb"] Jul 15 16:38:48.772203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.772123 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c9cf75b96-8t5b9"] Jul 15 16:38:48.772203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.772190 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.774644 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.774627 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 16:38:48.774748 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.774678 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rgnls\"" Jul 15 16:38:48.774819 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.774804 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 16:38:48.775104 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.775089 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 16:38:48.780531 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.780515 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 16:38:48.802102 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2zqt\" (UniqueName: \"kubernetes.io/projected/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-kube-api-access-h2zqt\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.802216 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/588c8e96-a074-4426-bb72-5d5aac6abc91-serving-cert\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.802216 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-serving-cert\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.802216 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-trusted-ca\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.802316 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c8e96-a074-4426-bb72-5d5aac6abc91-config\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.802316 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bthff\" (UniqueName: \"kubernetes.io/projected/588c8e96-a074-4426-bb72-5d5aac6abc91-kube-api-access-bthff\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.802316 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-config\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.802765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.802742 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c8e96-a074-4426-bb72-5d5aac6abc91-config\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.804272 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.804256 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/588c8e96-a074-4426-bb72-5d5aac6abc91-serving-cert\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.812163 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.812142 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x"] Jul 15 16:38:48.828189 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.828170 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:48.866856 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.866798 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 16:38:48.867045 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.866907 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 16:38:48.867138 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.867097 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 16:38:48.867138 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.867130 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 16:38:48.868860 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.868835 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bthff\" (UniqueName: \"kubernetes.io/projected/588c8e96-a074-4426-bb72-5d5aac6abc91-kube-api-access-bthff\") pod \"service-ca-operator-7695fc6c8c-pjtpq\" (UID: \"588c8e96-a074-4426-bb72-5d5aac6abc91\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.872687 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.872669 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4svgh\"" Jul 15 16:38:48.878433 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.878413 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp"] Jul 15 16:38:48.903165 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-certificates\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.903326 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-bound-sa-token\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.903326 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-serving-cert\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.903425 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-trusted-ca\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.903425 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.903521 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-installation-pull-secrets\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.903521 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffed9776-650c-4fb3-be21-14853570c7b5-nginx-conf\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:48.903521 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-config\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.903663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77df15b2-55e0-461a-9f14-fdfacb8c0e1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dff689dc4-s6f6x\" (UID: \"77df15b2-55e0-461a-9f14-fdfacb8c0e1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:48.903663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zsv\" (UniqueName: \"kubernetes.io/projected/77df15b2-55e0-461a-9f14-fdfacb8c0e1e-kube-api-access-p8zsv\") pod \"managed-serviceaccount-addon-agent-6dff689dc4-s6f6x\" (UID: \"77df15b2-55e0-461a-9f14-fdfacb8c0e1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:48.903663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:48.903663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-image-registry-private-configuration\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.903663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e447b54-0c14-43c9-bc11-46f83e676f4e-ca-trust-extracted\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.903663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903655 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6x52\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-kube-api-access-l6x52\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.903901 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2zqt\" (UniqueName: \"kubernetes.io/projected/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-kube-api-access-h2zqt\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.903901 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.903805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-trusted-ca\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:48.904252 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.904229 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-config\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.904346 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.904295 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:48.904405 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.904341 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-trusted-ca\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.906071 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.906049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-serving-cert\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.908191 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.908165 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x"] Jul 15 16:38:48.912186 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.911983 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 16:38:48.912440 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.912404 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 16:38:48.912686 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.912657 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 16:38:48.912967 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.912948 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:38:48.913223 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.913210 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8g7pt\"" Jul 15 16:38:48.913329 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.913310 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp"] Jul 15 16:38:48.940545 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.940526 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2zqt\" (UniqueName: \"kubernetes.io/projected/d6ef26f3-a755-4e38-a7da-9a18a3133b1f-kube-api-access-h2zqt\") pod \"console-operator-7866497494-vwvwt\" (UID: \"d6ef26f3-a755-4e38-a7da-9a18a3133b1f\") " pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:48.949472 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.949451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" Jul 15 16:38:48.963532 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:48.963505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:49.004754 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.004722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c3c3421-39b0-4cee-8ddb-741f8a534108-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.004834 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.004760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.004877 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.004844 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 16:38:49.004877 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.004855 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9cf75b96-8t5b9: secret "image-registry-tls" not found Jul 15 16:38:49.004877 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.004862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffed9776-650c-4fb3-be21-14853570c7b5-nginx-conf\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:49.004992 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.004904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-installation-pull-secrets\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.004992 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.004926 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls podName:7e447b54-0c14-43c9-bc11-46f83e676f4e nodeName:}" failed. No retries permitted until 2026-07-15 16:38:49.504910526 +0000 UTC m=+105.189159730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls") pod "image-registry-5c9cf75b96-8t5b9" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e") : secret "image-registry-tls" not found Jul 15 16:38:49.004992 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.004949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvb5c\" (UniqueName: \"kubernetes.io/projected/4c3c3421-39b0-4cee-8ddb-741f8a534108-kube-api-access-cvb5c\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.004992 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.004972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-bound-sa-token\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.005177 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zsv\" (UniqueName: \"kubernetes.io/projected/77df15b2-55e0-461a-9f14-fdfacb8c0e1e-kube-api-access-p8zsv\") pod \"managed-serviceaccount-addon-agent-6dff689dc4-s6f6x\" (UID: \"77df15b2-55e0-461a-9f14-fdfacb8c0e1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:49.005177 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e447b54-0c14-43c9-bc11-46f83e676f4e-ca-trust-extracted\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77df15b2-55e0-461a-9f14-fdfacb8c0e1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dff689dc4-s6f6x\" (UID: \"77df15b2-55e0-461a-9f14-fdfacb8c0e1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005464 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e447b54-0c14-43c9-bc11-46f83e676f4e-ca-trust-extracted\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-certificates\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.005544 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.005608 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert podName:ffed9776-650c-4fb3-be21-14853570c7b5 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:49.505590861 +0000 UTC m=+105.189840070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shtqb" (UID: "ffed9776-650c-4fb3-be21-14853570c7b5") : secret "networking-console-plugin-cert" not found Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005630 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffed9776-650c-4fb3-be21-14853570c7b5-nginx-conf\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-trusted-ca\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6x52\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-kube-api-access-l6x52\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3c3421-39b0-4cee-8ddb-741f8a534108-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.005797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.005750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-image-registry-private-configuration\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.006430 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.006045 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-certificates\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.006989 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.006943 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-trusted-ca\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.008118 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.008094 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-installation-pull-secrets\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.008204 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.008095 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-image-registry-private-configuration\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.008852 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.008832 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77df15b2-55e0-461a-9f14-fdfacb8c0e1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dff689dc4-s6f6x\" (UID: \"77df15b2-55e0-461a-9f14-fdfacb8c0e1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:49.018390 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.018350 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-bound-sa-token\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.021425 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.021362 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6x52\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-kube-api-access-l6x52\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.021844 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.021821 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zsv\" (UniqueName: \"kubernetes.io/projected/77df15b2-55e0-461a-9f14-fdfacb8c0e1e-kube-api-access-p8zsv\") pod \"managed-serviceaccount-addon-agent-6dff689dc4-s6f6x\" (UID: \"77df15b2-55e0-461a-9f14-fdfacb8c0e1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:49.106452 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.106426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c3c3421-39b0-4cee-8ddb-741f8a534108-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.106581 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.106482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvb5c\" (UniqueName: \"kubernetes.io/projected/4c3c3421-39b0-4cee-8ddb-741f8a534108-kube-api-access-cvb5c\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.106581 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.106536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3c3421-39b0-4cee-8ddb-741f8a534108-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.106992 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.106969 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c3c3421-39b0-4cee-8ddb-741f8a534108-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.108693 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.108673 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3c3421-39b0-4cee-8ddb-741f8a534108-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.128631 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.128573 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvb5c\" (UniqueName: \"kubernetes.io/projected/4c3c3421-39b0-4cee-8ddb-741f8a534108-kube-api-access-cvb5c\") pod \"kube-storage-version-migrator-operator-799cb7f958-qz6dp\" (UID: \"4c3c3421-39b0-4cee-8ddb-741f8a534108\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.131197 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.131177 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq"] Jul 15 16:38:49.133879 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:38:49.133860 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588c8e96_a074_4426_bb72_5d5aac6abc91.slice/crio-a621e5117fb656e8e802e0e0285dcbdbac83b95f45e309c09f943385ecd26f97 WatchSource:0}: Error finding container a621e5117fb656e8e802e0e0285dcbdbac83b95f45e309c09f943385ecd26f97: Status 404 returned error can't find the container with id a621e5117fb656e8e802e0e0285dcbdbac83b95f45e309c09f943385ecd26f97 Jul 15 16:38:49.148266 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.148247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" Jul 15 16:38:49.176288 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:38:49.176258 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ef26f3_a755_4e38_a7da_9a18a3133b1f.slice/crio-1b6e968052d45b84a18d781eb14f65afdfd9dec6819a5202ab63bdcd1ff052c4 WatchSource:0}: Error finding container 1b6e968052d45b84a18d781eb14f65afdfd9dec6819a5202ab63bdcd1ff052c4: Status 404 returned error can't find the container with id 1b6e968052d45b84a18d781eb14f65afdfd9dec6819a5202ab63bdcd1ff052c4 Jul 15 16:38:49.177622 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.177604 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vwvwt"] Jul 15 16:38:49.218816 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.218775 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" Jul 15 16:38:49.256648 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.256600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" event={"ID":"588c8e96-a074-4426-bb72-5d5aac6abc91","Type":"ContainerStarted","Data":"a621e5117fb656e8e802e0e0285dcbdbac83b95f45e309c09f943385ecd26f97"} Jul 15 16:38:49.257830 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.257785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vwvwt" event={"ID":"d6ef26f3-a755-4e38-a7da-9a18a3133b1f","Type":"ContainerStarted","Data":"1b6e968052d45b84a18d781eb14f65afdfd9dec6819a5202ab63bdcd1ff052c4"} Jul 15 16:38:49.311746 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.311718 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x"] Jul 15 16:38:49.314638 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:38:49.314607 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77df15b2_55e0_461a_9f14_fdfacb8c0e1e.slice/crio-72a82e48362030d875cb961196de735ed3b8ff860d7c0bcf6834026d4aa13c04 WatchSource:0}: Error finding container 72a82e48362030d875cb961196de735ed3b8ff860d7c0bcf6834026d4aa13c04: Status 404 returned error can't find the container with id 72a82e48362030d875cb961196de735ed3b8ff860d7c0bcf6834026d4aa13c04 Jul 15 16:38:49.394100 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.394000 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp"] Jul 15 16:38:49.397788 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:38:49.397761 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3c3421_39b0_4cee_8ddb_741f8a534108.slice/crio-5f7935c40f0acae9c1ce1a1e5cc1041f3e14d3007c7e43d959953eabe1a86d67 WatchSource:0}: Error finding container 5f7935c40f0acae9c1ce1a1e5cc1041f3e14d3007c7e43d959953eabe1a86d67: Status 404 returned error can't find the container with id 5f7935c40f0acae9c1ce1a1e5cc1041f3e14d3007c7e43d959953eabe1a86d67 Jul 15 16:38:49.510745 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.510707 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:49.510888 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:49.510779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:49.510888 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.510869 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 16:38:49.510888 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.510870 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:38:49.511007 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.510947 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert podName:ffed9776-650c-4fb3-be21-14853570c7b5 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:50.510929461 +0000 UTC m=+106.195178665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shtqb" (UID: "ffed9776-650c-4fb3-be21-14853570c7b5") : secret "networking-console-plugin-cert" not found Jul 15 16:38:49.511007 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.510880 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9cf75b96-8t5b9: secret "image-registry-tls" not found Jul 15 16:38:49.511007 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:49.511005 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls podName:7e447b54-0c14-43c9-bc11-46f83e676f4e nodeName:}" failed. No retries permitted until 2026-07-15 16:38:50.51099324 +0000 UTC m=+106.195242443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls") pod "image-registry-5c9cf75b96-8t5b9" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e") : secret "image-registry-tls" not found Jul 15 16:38:50.264409 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:50.264367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" event={"ID":"4c3c3421-39b0-4cee-8ddb-741f8a534108","Type":"ContainerStarted","Data":"5f7935c40f0acae9c1ce1a1e5cc1041f3e14d3007c7e43d959953eabe1a86d67"} Jul 15 16:38:50.265854 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:50.265825 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" event={"ID":"77df15b2-55e0-461a-9f14-fdfacb8c0e1e","Type":"ContainerStarted","Data":"72a82e48362030d875cb961196de735ed3b8ff860d7c0bcf6834026d4aa13c04"} Jul 15 16:38:50.519779 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:50.519244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:50.519779 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:50.519324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:50.519779 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:50.519450 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:38:50.519779 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:50.519520 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert podName:ffed9776-650c-4fb3-be21-14853570c7b5 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:52.519499073 +0000 UTC m=+108.203748297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shtqb" (UID: "ffed9776-650c-4fb3-be21-14853570c7b5") : secret "networking-console-plugin-cert" not found Jul 15 16:38:50.519779 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:50.519586 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 16:38:50.519779 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:50.519602 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9cf75b96-8t5b9: secret "image-registry-tls" not found Jul 15 16:38:50.519779 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:50.519640 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls podName:7e447b54-0c14-43c9-bc11-46f83e676f4e nodeName:}" failed. No retries permitted until 2026-07-15 16:38:52.519626439 +0000 UTC m=+108.203875664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls") pod "image-registry-5c9cf75b96-8t5b9" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e") : secret "image-registry-tls" not found Jul 15 16:38:52.536143 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.536112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:52.536444 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.536184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:52.536444 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.536249 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 16:38:52.536444 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.536272 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9cf75b96-8t5b9: secret "image-registry-tls" not found Jul 15 16:38:52.536444 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.536300 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:38:52.536444 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.536347 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls podName:7e447b54-0c14-43c9-bc11-46f83e676f4e nodeName:}" failed. No retries permitted until 2026-07-15 16:38:56.536324532 +0000 UTC m=+112.220573746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls") pod "image-registry-5c9cf75b96-8t5b9" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e") : secret "image-registry-tls" not found Jul 15 16:38:52.536444 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.536366 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert podName:ffed9776-650c-4fb3-be21-14853570c7b5 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:56.536357201 +0000 UTC m=+112.220606405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shtqb" (UID: "ffed9776-650c-4fb3-be21-14853570c7b5") : secret "networking-console-plugin-cert" not found Jul 15 16:38:52.713324 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.713292 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-txp5c"] Jul 15 16:38:52.716724 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.716700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.720272 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.720210 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 16:38:52.720272 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.720218 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 16:38:52.721097 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.721005 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 16:38:52.721380 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.721365 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 16:38:52.722252 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.722233 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j7mm5\"" Jul 15 16:38:52.745532 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.745437 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txp5c"] Jul 15 16:38:52.839175 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.839090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-data-volume\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.839175 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.839167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-crio-socket\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.839383 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.839238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.839383 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.839308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.839383 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.839333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7blv\" (UniqueName: \"kubernetes.io/projected/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-api-access-m7blv\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.939954 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.939914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-crio-socket\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.939954 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.939962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.940182 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.940000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.940182 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.940029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7blv\" (UniqueName: \"kubernetes.io/projected/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-api-access-m7blv\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.940182 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.940068 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-crio-socket\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.940182 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.940143 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:38:52.940182 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.940181 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:38:52.940387 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.940234 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:53.440212339 +0000 UTC m=+109.124461548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : configmap "kube-rbac-proxy" not found Jul 15 16:38:52.940387 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.940260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-data-volume\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.940387 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:52.940309 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:53.440292905 +0000 UTC m=+109.124542113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : secret "insights-runtime-extractor-tls" not found Jul 15 16:38:52.940623 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.940606 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-data-volume\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:52.950694 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:52.950665 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7blv\" (UniqueName: \"kubernetes.io/projected/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-api-access-m7blv\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:53.276663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.276623 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/0.log" Jul 15 16:38:53.276841 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.276673 2565 generic.go:356] "Generic (PLEG): container finished" podID="d6ef26f3-a755-4e38-a7da-9a18a3133b1f" containerID="e18ddffe0c750afa68f803ec514c8671b23d8026301a4b8890340a892ac84a59" exitCode=255 Jul 15 16:38:53.276841 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.276742 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vwvwt" event={"ID":"d6ef26f3-a755-4e38-a7da-9a18a3133b1f","Type":"ContainerDied","Data":"e18ddffe0c750afa68f803ec514c8671b23d8026301a4b8890340a892ac84a59"} Jul 15 16:38:53.276997 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.276983 2565 scope.go:117] "RemoveContainer" containerID="e18ddffe0c750afa68f803ec514c8671b23d8026301a4b8890340a892ac84a59" Jul 15 16:38:53.278144 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.278122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" event={"ID":"77df15b2-55e0-461a-9f14-fdfacb8c0e1e","Type":"ContainerStarted","Data":"6c734a76655b8e798a420bbf80b20e98fbbcd8be798fe174c30619f6506c761a"} Jul 15 16:38:53.327063 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.326997 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff689dc4-s6f6x" podStartSLOduration=2.056237485 podStartE2EDuration="5.326979983s" totalImagesPullingTime="3.270742498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:38:53.326623872 +0000 UTC m=+109.010873099" watchObservedRunningTime="2026-07-15 16:38:53.326979983 +0000 UTC m=+109.011229212" Jul 15 16:38:53.444315 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.444284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:53.444473 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:53.444347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:53.444544 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:53.444495 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:38:53.444586 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:53.444574 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:54.44455138 +0000 UTC m=+110.128800593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : secret "insights-runtime-extractor-tls" not found Jul 15 16:38:53.444969 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:53.444866 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:38:53.445122 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:53.444967 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:54.444946865 +0000 UTC m=+110.129196074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : configmap "kube-rbac-proxy" not found Jul 15 16:38:54.287894 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.287820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:38:54.288347 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.288279 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/0.log" Jul 15 16:38:54.288347 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.288315 2565 generic.go:356] "Generic (PLEG): container finished" podID="d6ef26f3-a755-4e38-a7da-9a18a3133b1f" containerID="d5035aa9f2ba5ed4f938db1f4c47564239a3c9bc595a492aaa1c6e76b2119661" exitCode=255 Jul 15 16:38:54.288439 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.288398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vwvwt" event={"ID":"d6ef26f3-a755-4e38-a7da-9a18a3133b1f","Type":"ContainerDied","Data":"d5035aa9f2ba5ed4f938db1f4c47564239a3c9bc595a492aaa1c6e76b2119661"} Jul 15 16:38:54.288502 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.288488 2565 scope.go:117] "RemoveContainer" containerID="e18ddffe0c750afa68f803ec514c8671b23d8026301a4b8890340a892ac84a59" Jul 15 16:38:54.288836 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.288814 2565 scope.go:117] "RemoveContainer" containerID="d5035aa9f2ba5ed4f938db1f4c47564239a3c9bc595a492aaa1c6e76b2119661" Jul 15 16:38:54.289120 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:54.289086 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vwvwt_openshift-console-operator(d6ef26f3-a755-4e38-a7da-9a18a3133b1f)\"" pod="openshift-console-operator/console-operator-7866497494-vwvwt" podUID="d6ef26f3-a755-4e38-a7da-9a18a3133b1f" Jul 15 16:38:54.290436 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.290398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" event={"ID":"4c3c3421-39b0-4cee-8ddb-741f8a534108","Type":"ContainerStarted","Data":"f0f61a50644bb37af55ce4883fea2f0d090df315ee41bf6b9a5a5247131f4894"} Jul 15 16:38:54.291940 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.291907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" event={"ID":"588c8e96-a074-4426-bb72-5d5aac6abc91","Type":"ContainerStarted","Data":"4ac2617d853b0b7cf4a2c2772e1cbaed543101d5317d1cb84459f80d03fc1a46"} Jul 15 16:38:54.380247 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.380196 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" podStartSLOduration=1.533245377 podStartE2EDuration="6.380177054s" totalImagesPullingTime="4.846931677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:38:54.354650019 +0000 UTC m=+110.038899246" watchObservedRunningTime="2026-07-15 16:38:54.380177054 +0000 UTC m=+110.064426281" Jul 15 16:38:54.380965 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.380934 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" podStartSLOduration=2.468944579 podStartE2EDuration="6.380925912s" totalImagesPullingTime="3.911981333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:38:54.379900659 +0000 UTC m=+110.064149887" watchObservedRunningTime="2026-07-15 16:38:54.380925912 +0000 UTC m=+110.065175139" Jul 15 16:38:54.453536 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.453494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:54.453732 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:54.453622 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:38:54.453732 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:54.453697 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:56.453675663 +0000 UTC m=+112.137924871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : configmap "kube-rbac-proxy" not found Jul 15 16:38:54.453732 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:54.453702 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:38:54.453900 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:54.453763 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:38:56.45374442 +0000 UTC m=+112.137993625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : secret "insights-runtime-extractor-tls" not found Jul 15 16:38:54.453951 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.453623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:54.496277 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:54.496248 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9q65d_8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4/dns-node-resolver/0.log" Jul 15 16:38:55.295762 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:55.295733 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:38:55.296228 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:55.296101 2565 scope.go:117] "RemoveContainer" containerID="d5035aa9f2ba5ed4f938db1f4c47564239a3c9bc595a492aaa1c6e76b2119661" Jul 15 16:38:55.296333 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:55.296309 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vwvwt_openshift-console-operator(d6ef26f3-a755-4e38-a7da-9a18a3133b1f)\"" pod="openshift-console-operator/console-operator-7866497494-vwvwt" podUID="d6ef26f3-a755-4e38-a7da-9a18a3133b1f" Jul 15 16:38:55.883183 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:55.883156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w9czq_1b7e6012-1e83-42e3-a85d-abb838b5661f/node-ca/0.log" Jul 15 16:38:56.283387 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:56.283353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8d5nb_57543dc7-126e-4692-ac17-a891fb0e71b2/serve-healthcheck-canary/0.log" Jul 15 16:38:56.473500 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:56.473464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:56.473937 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:56.473511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:38:56.473937 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.473613 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:38:56.473937 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.473687 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:38:56.473937 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.473713 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:00.473676341 +0000 UTC m=+116.157925565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : configmap "kube-rbac-proxy" not found Jul 15 16:38:56.473937 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.473736 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:00.473724037 +0000 UTC m=+116.157973245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : secret "insights-runtime-extractor-tls" not found Jul 15 16:38:56.573841 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:56.573740 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:38:56.573841 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:56.573812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:38:56.574066 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.573894 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 16:38:56.574066 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.573916 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9cf75b96-8t5b9: secret "image-registry-tls" not found Jul 15 16:38:56.574066 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.573940 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:38:56.574066 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.573984 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls podName:7e447b54-0c14-43c9-bc11-46f83e676f4e nodeName:}" failed. No retries permitted until 2026-07-15 16:39:04.573964658 +0000 UTC m=+120.258213866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls") pod "image-registry-5c9cf75b96-8t5b9" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e") : secret "image-registry-tls" not found Jul 15 16:38:56.574066 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:56.573998 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert podName:ffed9776-650c-4fb3-be21-14853570c7b5 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:04.573991728 +0000 UTC m=+120.258240931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shtqb" (UID: "ffed9776-650c-4fb3-be21-14853570c7b5") : secret "networking-console-plugin-cert" not found Jul 15 16:38:57.732093 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.732058 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8js8c"] Jul 15 16:38:57.734790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.734773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.737637 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.737613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 16:38:57.737768 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.737680 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 16:38:57.738723 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.738708 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 16:38:57.738723 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.738713 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pngjl\"" Jul 15 16:38:57.738865 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.738728 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 16:38:57.744509 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.744491 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8js8c"] Jul 15 16:38:57.884231 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.884197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2vq\" (UniqueName: \"kubernetes.io/projected/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-kube-api-access-mf2vq\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.884231 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.884229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-signing-key\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.884432 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.884258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-signing-cabundle\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.985264 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.985185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2vq\" (UniqueName: \"kubernetes.io/projected/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-kube-api-access-mf2vq\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.985264 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.985217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-signing-key\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.985264 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.985240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-signing-cabundle\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.985937 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.985917 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-signing-cabundle\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.987624 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.987608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-signing-key\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:57.994739 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:57.994716 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2vq\" (UniqueName: \"kubernetes.io/projected/c8d99d10-d210-4e6a-81d7-dd766ccd7b4c-kube-api-access-mf2vq\") pod \"service-ca-79f68b9f4f-8js8c\" (UID: \"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:58.043730 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:58.043693 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" Jul 15 16:38:58.166871 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:58.166841 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8js8c"] Jul 15 16:38:58.170124 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:38:58.170087 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d99d10_d210_4e6a_81d7_dd766ccd7b4c.slice/crio-2a76f4425de0d36d556544bc7dc36fd97ee97fd2a2ff874b3850ff753c9b282d WatchSource:0}: Error finding container 2a76f4425de0d36d556544bc7dc36fd97ee97fd2a2ff874b3850ff753c9b282d: Status 404 returned error can't find the container with id 2a76f4425de0d36d556544bc7dc36fd97ee97fd2a2ff874b3850ff753c9b282d Jul 15 16:38:58.309799 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:58.309715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" event={"ID":"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c","Type":"ContainerStarted","Data":"ee2ed1ca70ebd11d85f3fed26c83a948f31889f5d10b63a92338d37a384e7239"} Jul 15 16:38:58.309799 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:58.309768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" event={"ID":"c8d99d10-d210-4e6a-81d7-dd766ccd7b4c","Type":"ContainerStarted","Data":"2a76f4425de0d36d556544bc7dc36fd97ee97fd2a2ff874b3850ff753c9b282d"} Jul 15 16:38:58.963933 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:58.963892 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:58.964432 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:58.963949 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:38:58.964432 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:38:58.964286 2565 scope.go:117] "RemoveContainer" containerID="d5035aa9f2ba5ed4f938db1f4c47564239a3c9bc595a492aaa1c6e76b2119661" Jul 15 16:38:58.964531 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:38:58.964434 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vwvwt_openshift-console-operator(d6ef26f3-a755-4e38-a7da-9a18a3133b1f)\"" pod="openshift-console-operator/console-operator-7866497494-vwvwt" podUID="d6ef26f3-a755-4e38-a7da-9a18a3133b1f" Jul 15 16:39:00.508900 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:00.508853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:00.509322 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:00.508992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:00.509322 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:00.509044 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:39:00.509322 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:00.509118 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:08.509101799 +0000 UTC m=+124.193351006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : secret "insights-runtime-extractor-tls" not found Jul 15 16:39:00.509322 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:00.509132 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 16:39:00.509322 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:00.509199 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:08.509181015 +0000 UTC m=+124.193430231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : configmap "kube-rbac-proxy" not found Jul 15 16:39:04.645118 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:04.645067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:39:04.645543 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:04.645153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:39:04.645543 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:04.645335 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 16:39:04.645543 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:04.645422 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert podName:ffed9776-650c-4fb3-be21-14853570c7b5 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:20.645398924 +0000 UTC m=+136.329648129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shtqb" (UID: "ffed9776-650c-4fb3-be21-14853570c7b5") : secret "networking-console-plugin-cert" not found Jul 15 16:39:04.647618 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:04.647595 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"image-registry-5c9cf75b96-8t5b9\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:39:04.681256 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:04.681220 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:39:04.821809 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:04.821764 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-8js8c" podStartSLOduration=7.8217490739999995 podStartE2EDuration="7.821749074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:38:58.335259305 +0000 UTC m=+114.019508532" watchObservedRunningTime="2026-07-15 16:39:04.821749074 +0000 UTC m=+120.505998299" Jul 15 16:39:04.822698 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:04.822680 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c9cf75b96-8t5b9"] Jul 15 16:39:04.825447 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:04.825410 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e447b54_0c14_43c9_bc11_46f83e676f4e.slice/crio-13bb27e9b8fbcf100e7db9066b0d497092fc852c316419efd7fc020d3df177cd WatchSource:0}: Error finding container 13bb27e9b8fbcf100e7db9066b0d497092fc852c316419efd7fc020d3df177cd: Status 404 returned error can't find the container with id 13bb27e9b8fbcf100e7db9066b0d497092fc852c316419efd7fc020d3df177cd Jul 15 16:39:05.332725 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:05.332692 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" event={"ID":"7e447b54-0c14-43c9-bc11-46f83e676f4e","Type":"ContainerStarted","Data":"548a49256ad7b04e0b2bc3482b7eecb8c0246c1f0fdc6ab4e684a838f6b7582f"} Jul 15 16:39:05.332887 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:05.332746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" event={"ID":"7e447b54-0c14-43c9-bc11-46f83e676f4e","Type":"ContainerStarted","Data":"13bb27e9b8fbcf100e7db9066b0d497092fc852c316419efd7fc020d3df177cd"} Jul 15 16:39:05.332887 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:05.332773 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:39:05.366772 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:05.366716 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" podStartSLOduration=17.366694474 podStartE2EDuration="17.366694474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:05.365516644 +0000 UTC m=+121.049765889" watchObservedRunningTime="2026-07-15 16:39:05.366694474 +0000 UTC m=+121.050943703" Jul 15 16:39:08.577888 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:08.577843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:08.578310 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:08.577901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:08.578310 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:08.578035 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 16:39:08.578310 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:08.578132 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls podName:2be53ffe-4f8b-4bef-a2e7-6e2764c38b24 nodeName:}" failed. No retries permitted until 2026-07-15 16:39:24.57811477 +0000 UTC m=+140.262363994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txp5c" (UID: "2be53ffe-4f8b-4bef-a2e7-6e2764c38b24") : secret "insights-runtime-extractor-tls" not found Jul 15 16:39:08.578439 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:08.578402 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:09.893211 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:09.893171 2565 scope.go:117] "RemoveContainer" containerID="d5035aa9f2ba5ed4f938db1f4c47564239a3c9bc595a492aaa1c6e76b2119661" Jul 15 16:39:10.348396 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:10.348370 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:39:10.348554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:10.348442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vwvwt" event={"ID":"d6ef26f3-a755-4e38-a7da-9a18a3133b1f","Type":"ContainerStarted","Data":"7d05f0e5309adf3f31a67d548203b8d2c199b6d7f95a13730e9199971efdf1d2"} Jul 15 16:39:10.348737 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:10.348713 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:39:10.368766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:10.368715 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-vwvwt" podStartSLOduration=19.009035558 podStartE2EDuration="22.368697885s" totalImagesPullingTime="3.359662327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:10.368367405 +0000 UTC m=+126.052616630" watchObservedRunningTime="2026-07-15 16:39:10.368697885 +0000 UTC m=+126.052947113" Jul 15 16:39:10.646932 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:10.646857 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-vwvwt" Jul 15 16:39:14.626995 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:14.626936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:39:14.629308 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:14.629283 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7440086-cac0-41f4-87d0-5f42a2e670d2-metrics-certs\") pod \"network-metrics-daemon-s7b8h\" (UID: \"e7440086-cac0-41f4-87d0-5f42a2e670d2\") " pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:39:14.823462 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:14.823426 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jvllt\"" Jul 15 16:39:14.830709 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:14.830679 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7b8h" Jul 15 16:39:14.969406 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:14.969374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s7b8h"] Jul 15 16:39:14.972422 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:14.972394 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7440086_cac0_41f4_87d0_5f42a2e670d2.slice/crio-3977c25f48160e5541a7a79d00babff1b58882cdf183ab6eb004956b39e4abae WatchSource:0}: Error finding container 3977c25f48160e5541a7a79d00babff1b58882cdf183ab6eb004956b39e4abae: Status 404 returned error can't find the container with id 3977c25f48160e5541a7a79d00babff1b58882cdf183ab6eb004956b39e4abae Jul 15 16:39:15.364188 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:15.364150 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7b8h" event={"ID":"e7440086-cac0-41f4-87d0-5f42a2e670d2","Type":"ContainerStarted","Data":"3977c25f48160e5541a7a79d00babff1b58882cdf183ab6eb004956b39e4abae"} Jul 15 16:39:17.372176 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:17.372136 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7b8h" event={"ID":"e7440086-cac0-41f4-87d0-5f42a2e670d2","Type":"ContainerStarted","Data":"d6f1fd93de5c46b7810e726e41f59ebdd983277e73dfd16a4c82dbd0773df85b"} Jul 15 16:39:17.372577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:17.372191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7b8h" event={"ID":"e7440086-cac0-41f4-87d0-5f42a2e670d2","Type":"ContainerStarted","Data":"27dfe2d544a6ee176aa894c39daa7cc49f9e3980ab104cd7a6c4609e026d83ed"} Jul 15 16:39:18.747405 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.747345 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s7b8h" podStartSLOduration=133.392843561 podStartE2EDuration="2m14.747320603s" totalImagesPullingTime="1.354477042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:17.397693098 +0000 UTC m=+133.081942323" watchObservedRunningTime="2026-07-15 16:39:18.747320603 +0000 UTC m=+134.431569830" Jul 15 16:39:18.748513 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.748489 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-w28wt"] Jul 15 16:39:18.751513 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.751491 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-w28wt" Jul 15 16:39:18.755672 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.755648 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g7j6l\"" Jul 15 16:39:18.755781 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.755750 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 16:39:18.756911 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.756887 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c9cf75b96-8t5b9"] Jul 15 16:39:18.758643 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.758439 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 16:39:18.774480 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.774456 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-w28wt"] Jul 15 16:39:18.861175 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.861137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4hzn\" (UniqueName: \"kubernetes.io/projected/fed2e660-9bca-418e-a5a2-e4ef08969713-kube-api-access-b4hzn\") pod \"downloads-68c9cbb497-w28wt\" (UID: \"fed2e660-9bca-418e-a5a2-e4ef08969713\") " pod="openshift-console/downloads-68c9cbb497-w28wt" Jul 15 16:39:18.962098 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.962059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4hzn\" (UniqueName: \"kubernetes.io/projected/fed2e660-9bca-418e-a5a2-e4ef08969713-kube-api-access-b4hzn\") pod \"downloads-68c9cbb497-w28wt\" (UID: \"fed2e660-9bca-418e-a5a2-e4ef08969713\") " pod="openshift-console/downloads-68c9cbb497-w28wt" Jul 15 16:39:18.980884 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:18.980849 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4hzn\" (UniqueName: \"kubernetes.io/projected/fed2e660-9bca-418e-a5a2-e4ef08969713-kube-api-access-b4hzn\") pod \"downloads-68c9cbb497-w28wt\" (UID: \"fed2e660-9bca-418e-a5a2-e4ef08969713\") " pod="openshift-console/downloads-68c9cbb497-w28wt" Jul 15 16:39:19.061413 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:19.061331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-w28wt" Jul 15 16:39:19.192086 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:19.192054 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-w28wt"] Jul 15 16:39:19.196100 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:19.196068 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed2e660_9bca_418e_a5a2_e4ef08969713.slice/crio-2956cb0916d5c9ae73348dcc6fab962a0711a0aaadfb43e8d6cd14065732bdc5 WatchSource:0}: Error finding container 2956cb0916d5c9ae73348dcc6fab962a0711a0aaadfb43e8d6cd14065732bdc5: Status 404 returned error can't find the container with id 2956cb0916d5c9ae73348dcc6fab962a0711a0aaadfb43e8d6cd14065732bdc5 Jul 15 16:39:19.381577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:19.381475 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-w28wt" event={"ID":"fed2e660-9bca-418e-a5a2-e4ef08969713","Type":"ContainerStarted","Data":"2956cb0916d5c9ae73348dcc6fab962a0711a0aaadfb43e8d6cd14065732bdc5"} Jul 15 16:39:20.678537 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:20.678497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:39:20.681167 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:20.681139 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ffed9776-650c-4fb3-be21-14853570c7b5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shtqb\" (UID: \"ffed9776-650c-4fb3-be21-14853570c7b5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:39:20.860559 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:20.860527 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v2sp4\"" Jul 15 16:39:20.868674 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:20.868642 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" Jul 15 16:39:21.018505 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:21.018465 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-shtqb"] Jul 15 16:39:21.022776 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:21.022746 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffed9776_650c_4fb3_be21_14853570c7b5.slice/crio-71069d5ba20b05a5c30588110b614bf430d5b201f97796bdf68d81af328935fe WatchSource:0}: Error finding container 71069d5ba20b05a5c30588110b614bf430d5b201f97796bdf68d81af328935fe: Status 404 returned error can't find the container with id 71069d5ba20b05a5c30588110b614bf430d5b201f97796bdf68d81af328935fe Jul 15 16:39:21.390105 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:21.390068 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" event={"ID":"ffed9776-650c-4fb3-be21-14853570c7b5","Type":"ContainerStarted","Data":"71069d5ba20b05a5c30588110b614bf430d5b201f97796bdf68d81af328935fe"} Jul 15 16:39:23.371634 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.371559 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5c5596f6-xfnqt"] Jul 15 16:39:23.379644 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.378743 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.383577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.383220 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 16:39:23.383577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.383365 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 16:39:23.383577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.383401 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 16:39:23.383577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.383451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mtjsr\"" Jul 15 16:39:23.383577 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.383475 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 16:39:23.387211 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.386857 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5c5596f6-xfnqt"] Jul 15 16:39:23.387211 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.387004 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 16:39:23.505132 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.505096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-oauth-config\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.505308 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.505160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-service-ca\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.505308 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.505280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-oauth-serving-cert\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.505445 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.505357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j558m\" (UniqueName: \"kubernetes.io/projected/1ce1e0fd-1413-490d-b185-0dbf8323e05f-kube-api-access-j558m\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.505445 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.505400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-serving-cert\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.505445 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.505427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-config\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.606169 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.606139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-serving-cert\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.606325 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.606179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-config\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.606325 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.606233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-oauth-config\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.606435 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.606370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-service-ca\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.606489 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.606445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-oauth-serving-cert\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.606543 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.606501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j558m\" (UniqueName: \"kubernetes.io/projected/1ce1e0fd-1413-490d-b185-0dbf8323e05f-kube-api-access-j558m\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.607073 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.607049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-config\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.607360 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.607328 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-service-ca\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.607468 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.607334 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-oauth-serving-cert\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.608888 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.608864 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-oauth-config\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.609141 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.609094 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-serving-cert\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.619602 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.619575 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j558m\" (UniqueName: \"kubernetes.io/projected/1ce1e0fd-1413-490d-b185-0dbf8323e05f-kube-api-access-j558m\") pod \"console-6b5c5596f6-xfnqt\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.694832 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.694788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:23.856610 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:23.856579 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5c5596f6-xfnqt"] Jul 15 16:39:23.859469 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:23.859422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce1e0fd_1413_490d_b185_0dbf8323e05f.slice/crio-14248390ed13e4f353c9912c0e5b962cbb6910f461b98392ed46c49332496179 WatchSource:0}: Error finding container 14248390ed13e4f353c9912c0e5b962cbb6910f461b98392ed46c49332496179: Status 404 returned error can't find the container with id 14248390ed13e4f353c9912c0e5b962cbb6910f461b98392ed46c49332496179 Jul 15 16:39:24.403870 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:24.403828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" event={"ID":"ffed9776-650c-4fb3-be21-14853570c7b5","Type":"ContainerStarted","Data":"b2588ce1d095dd7867f95985b2d923b4aa51099dba154e359a20b2741f7abcd0"} Jul 15 16:39:24.405201 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:24.405168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5c5596f6-xfnqt" event={"ID":"1ce1e0fd-1413-490d-b185-0dbf8323e05f","Type":"ContainerStarted","Data":"14248390ed13e4f353c9912c0e5b962cbb6910f461b98392ed46c49332496179"} Jul 15 16:39:24.425448 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:24.425400 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-shtqb" podStartSLOduration=33.898981522 podStartE2EDuration="36.425382264s" totalImagesPullingTime="2.526400742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:24.424964755 +0000 UTC m=+140.109213981" watchObservedRunningTime="2026-07-15 16:39:24.425382264 +0000 UTC m=+140.109631489" Jul 15 16:39:24.618142 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:24.618090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:24.621004 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:24.620945 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2be53ffe-4f8b-4bef-a2e7-6e2764c38b24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txp5c\" (UID: \"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24\") " pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:24.858545 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:24.858518 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j7mm5\"" Jul 15 16:39:24.864696 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:24.864677 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txp5c" Jul 15 16:39:25.022039 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:25.021991 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txp5c"] Jul 15 16:39:25.024676 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:25.024648 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be53ffe_4f8b_4bef_a2e7_6e2764c38b24.slice/crio-4f816fa95a1b7a733c5305155cb16b688f08c61b70cfffbad30a6690b00516d8 WatchSource:0}: Error finding container 4f816fa95a1b7a733c5305155cb16b688f08c61b70cfffbad30a6690b00516d8: Status 404 returned error can't find the container with id 4f816fa95a1b7a733c5305155cb16b688f08c61b70cfffbad30a6690b00516d8 Jul 15 16:39:25.420205 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:25.420084 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txp5c" event={"ID":"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24","Type":"ContainerStarted","Data":"4f816fa95a1b7a733c5305155cb16b688f08c61b70cfffbad30a6690b00516d8"} Jul 15 16:39:28.764582 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:28.764479 2565 patch_prober.go:28] interesting pod/image-registry-5c9cf75b96-8t5b9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 16:39:28.764582 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:28.764559 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" podUID="7e447b54-0c14-43c9-bc11-46f83e676f4e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 16:39:32.482531 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.482467 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bq4rh"] Jul 15 16:39:32.486937 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.486392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.489196 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.489164 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 16:39:32.489511 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.489179 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 16:39:32.490827 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.490803 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2zls9\"" Jul 15 16:39:32.491214 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.491058 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 16:39:32.491214 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.491171 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 16:39:32.491848 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.491573 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 16:39:32.492348 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.491990 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 16:39:32.499053 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.499002 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9chzs"] Jul 15 16:39:32.512696 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.512666 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bq4rh"] Jul 15 16:39:32.512862 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.512821 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.520561 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.520535 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 16:39:32.520843 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.520699 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jgbnv\"" Jul 15 16:39:32.520843 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.520545 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 16:39:32.520995 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.520977 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 16:39:32.589316 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-root\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589487 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589487 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a02fffb1-68a8-48bd-be4e-9770ea034dab-metrics-client-ca\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589487 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-sys\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589604 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-wtmp\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589604 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2jc\" (UniqueName: \"kubernetes.io/projected/a02fffb1-68a8-48bd-be4e-9770ea034dab-kube-api-access-9k2jc\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589675 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.589726 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk42d\" (UniqueName: \"kubernetes.io/projected/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-api-access-gk42d\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.589782 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-tls\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589782 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-textfile\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.589864 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.589911 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d5115b9-d105-4b63-8d63-286e4b370c6c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.590010 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-accelerators-collector-config\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.590010 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.590010 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.589977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d5115b9-d105-4b63-8d63-286e4b370c6c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.691083 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk42d\" (UniqueName: \"kubernetes.io/projected/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-api-access-gk42d\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.691083 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-tls\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.691394 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-textfile\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.691394 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.691394 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d5115b9-d105-4b63-8d63-286e4b370c6c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.691394 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:32.691231 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 16:39:32.691394 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:32.691302 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-tls podName:a02fffb1-68a8-48bd-be4e-9770ea034dab nodeName:}" failed. No retries permitted until 2026-07-15 16:39:33.191280219 +0000 UTC m=+148.875529435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-tls") pod "node-exporter-9chzs" (UID: "a02fffb1-68a8-48bd-be4e-9770ea034dab") : secret "node-exporter-tls" not found Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-accelerators-collector-config\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d5115b9-d105-4b63-8d63-286e4b370c6c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691506 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-root\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691547 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-textfile\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691569 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a02fffb1-68a8-48bd-be4e-9770ea034dab-metrics-client-ca\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-sys\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-wtmp\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2jc\" (UniqueName: \"kubernetes.io/projected/a02fffb1-68a8-48bd-be4e-9770ea034dab-kube-api-access-9k2jc\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691840 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d5115b9-d105-4b63-8d63-286e4b370c6c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.691982 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-wtmp\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.692053 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-sys\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.692175 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a02fffb1-68a8-48bd-be4e-9770ea034dab-metrics-client-ca\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.692224 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-accelerators-collector-config\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.692446 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.692240 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a02fffb1-68a8-48bd-be4e-9770ea034dab-root\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.693362 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.692286 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.693362 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.692894 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d5115b9-d105-4b63-8d63-286e4b370c6c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.695092 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.695070 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.695237 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.695213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.695319 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.695235 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.711376 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.711309 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2jc\" (UniqueName: \"kubernetes.io/projected/a02fffb1-68a8-48bd-be4e-9770ea034dab-kube-api-access-9k2jc\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:32.711516 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.711389 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk42d\" (UniqueName: \"kubernetes.io/projected/0d5115b9-d105-4b63-8d63-286e4b370c6c-kube-api-access-gk42d\") pod \"kube-state-metrics-785778ff74-bq4rh\" (UID: \"0d5115b9-d105-4b63-8d63-286e4b370c6c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:32.811305 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:32.811209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" Jul 15 16:39:33.201471 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:33.201380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-tls\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:33.204286 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:33.204256 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a02fffb1-68a8-48bd-be4e-9770ea034dab-node-exporter-tls\") pod \"node-exporter-9chzs\" (UID: \"a02fffb1-68a8-48bd-be4e-9770ea034dab\") " pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:33.424313 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:33.424272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9chzs" Jul 15 16:39:36.921213 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.921185 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-778f7fffd9-fjc5p"] Jul 15 16:39:36.924594 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.924565 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:36.928764 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.928739 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 15 16:39:36.931244 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.931217 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 16:39:36.931489 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.931470 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 15 16:39:36.932125 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.932100 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9kxc5\"" Jul 15 16:39:36.933299 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.932460 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 15 16:39:36.933299 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.932924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aun75a6v0q327\"" Jul 15 16:39:36.936325 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:36.936286 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-778f7fffd9-fjc5p"] Jul 15 16:39:37.038907 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.038862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xchqw\" (UniqueName: \"kubernetes.io/projected/11f7d913-c732-40b1-98c5-d70d23995305-kube-api-access-xchqw\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.039258 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.039226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-client-ca-bundle\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.039399 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.039306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-secret-metrics-server-client-certs\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.039399 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.039354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/11f7d913-c732-40b1-98c5-d70d23995305-audit-log\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.039399 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.039384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/11f7d913-c732-40b1-98c5-d70d23995305-metrics-server-audit-profiles\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.039569 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.039483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-secret-metrics-server-tls\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.039569 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.039556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7d913-c732-40b1-98c5-d70d23995305-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.140433 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.140398 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-secret-metrics-server-tls\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.140628 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.140458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7d913-c732-40b1-98c5-d70d23995305-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.140628 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.140500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xchqw\" (UniqueName: \"kubernetes.io/projected/11f7d913-c732-40b1-98c5-d70d23995305-kube-api-access-xchqw\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.140628 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.140554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-client-ca-bundle\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.140628 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.140610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-secret-metrics-server-client-certs\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.140834 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.140645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/11f7d913-c732-40b1-98c5-d70d23995305-audit-log\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.140834 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.140674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/11f7d913-c732-40b1-98c5-d70d23995305-metrics-server-audit-profiles\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.141765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.141675 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7d913-c732-40b1-98c5-d70d23995305-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.142068 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.142004 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/11f7d913-c732-40b1-98c5-d70d23995305-audit-log\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.142179 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.142099 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/11f7d913-c732-40b1-98c5-d70d23995305-metrics-server-audit-profiles\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.143470 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.143427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-secret-metrics-server-tls\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.144044 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.144003 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-client-ca-bundle\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.144417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.144369 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7d913-c732-40b1-98c5-d70d23995305-secret-metrics-server-client-certs\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.153310 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.153285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xchqw\" (UniqueName: \"kubernetes.io/projected/11f7d913-c732-40b1-98c5-d70d23995305-kube-api-access-xchqw\") pod \"metrics-server-778f7fffd9-fjc5p\" (UID: \"11f7d913-c732-40b1-98c5-d70d23995305\") " pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:37.237676 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:37.237635 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:38.172722 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:38.172679 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02fffb1_68a8_48bd_be4e_9770ea034dab.slice/crio-9f13407228aa7445dacc3cf4dcf83fbc9e9a95a8f020aa9de0b4cfc864cf65ca WatchSource:0}: Error finding container 9f13407228aa7445dacc3cf4dcf83fbc9e9a95a8f020aa9de0b4cfc864cf65ca: Status 404 returned error can't find the container with id 9f13407228aa7445dacc3cf4dcf83fbc9e9a95a8f020aa9de0b4cfc864cf65ca Jul 15 16:39:38.191702 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.191674 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5c5596f6-xfnqt"] Jul 15 16:39:38.227661 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.226633 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8465bf4648-fgg8c"] Jul 15 16:39:38.234813 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.234783 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.247842 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.247809 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 16:39:38.261284 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.260978 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8465bf4648-fgg8c"] Jul 15 16:39:38.340904 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.340866 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-778f7fffd9-fjc5p"] Jul 15 16:39:38.344627 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:38.344347 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f7d913_c732_40b1_98c5_d70d23995305.slice/crio-6113474530c97a616605d77e9c2b2f5be4916a77f73a9af479953c90b38b8c8a WatchSource:0}: Error finding container 6113474530c97a616605d77e9c2b2f5be4916a77f73a9af479953c90b38b8c8a: Status 404 returned error can't find the container with id 6113474530c97a616605d77e9c2b2f5be4916a77f73a9af479953c90b38b8c8a Jul 15 16:39:38.356241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.356117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-console-config\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.356241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.356161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-trusted-ca-bundle\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.356241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.356183 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-oauth-serving-cert\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.356241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.356212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-serving-cert\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.356241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.356236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-oauth-config\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.356552 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.356313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vbj\" (UniqueName: \"kubernetes.io/projected/37199c66-3117-4ee8-af1e-220323fc8e7e-kube-api-access-78vbj\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.356552 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.356332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-service-ca\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.370404 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.370373 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bq4rh"] Jul 15 16:39:38.374900 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:38.374873 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d5115b9_d105_4b63_8d63_286e4b370c6c.slice/crio-b885a4c7a790410c1c71071c7beaa6d88441ce508b8e8b8b1b8575d3c96ca19f WatchSource:0}: Error finding container b885a4c7a790410c1c71071c7beaa6d88441ce508b8e8b8b1b8575d3c96ca19f: Status 404 returned error can't find the container with id b885a4c7a790410c1c71071c7beaa6d88441ce508b8e8b8b1b8575d3c96ca19f Jul 15 16:39:38.457795 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.457756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-trusted-ca-bundle\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.457959 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.457816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-oauth-serving-cert\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.457959 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.457857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-serving-cert\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.457959 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.457875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-oauth-config\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.458168 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.457965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vbj\" (UniqueName: \"kubernetes.io/projected/37199c66-3117-4ee8-af1e-220323fc8e7e-kube-api-access-78vbj\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.458168 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.457999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-service-ca\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.458168 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.458069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-console-config\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.458750 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.458692 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-oauth-serving-cert\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.458878 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.458779 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-console-config\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.458878 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.458837 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-trusted-ca-bundle\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.459373 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.459341 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-service-ca\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.460984 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.460960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-serving-cert\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.461094 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.461082 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-oauth-config\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.467806 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.467782 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vbj\" (UniqueName: \"kubernetes.io/projected/37199c66-3117-4ee8-af1e-220323fc8e7e-kube-api-access-78vbj\") pod \"console-8465bf4648-fgg8c\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.474607 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.474581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txp5c" event={"ID":"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24","Type":"ContainerStarted","Data":"89af021c0d8ecd4afb6d75786846aefc9d00aaebd3f6179b8667bfd5682c2a92"} Jul 15 16:39:38.476055 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.476001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" event={"ID":"0d5115b9-d105-4b63-8d63-286e4b370c6c","Type":"ContainerStarted","Data":"b885a4c7a790410c1c71071c7beaa6d88441ce508b8e8b8b1b8575d3c96ca19f"} Jul 15 16:39:38.477440 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.477417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9chzs" event={"ID":"a02fffb1-68a8-48bd-be4e-9770ea034dab","Type":"ContainerStarted","Data":"9f13407228aa7445dacc3cf4dcf83fbc9e9a95a8f020aa9de0b4cfc864cf65ca"} Jul 15 16:39:38.479150 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.479125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5c5596f6-xfnqt" event={"ID":"1ce1e0fd-1413-490d-b185-0dbf8323e05f","Type":"ContainerStarted","Data":"87487c4697e1c3419e7f2e5e3a9a11c188a93b6a6358d7644361773855be718c"} Jul 15 16:39:38.481055 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.481009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" event={"ID":"11f7d913-c732-40b1-98c5-d70d23995305","Type":"ContainerStarted","Data":"6113474530c97a616605d77e9c2b2f5be4916a77f73a9af479953c90b38b8c8a"} Jul 15 16:39:38.482798 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.482772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-w28wt" event={"ID":"fed2e660-9bca-418e-a5a2-e4ef08969713","Type":"ContainerStarted","Data":"bd36c6d8d2dbd4cbcd64cf917a7c7bd828e919719c1334d511014dc858fd9c5c"} Jul 15 16:39:38.483064 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.483008 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-w28wt" Jul 15 16:39:38.491950 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.491923 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-w28wt" Jul 15 16:39:38.530985 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.530919 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b5c5596f6-xfnqt" podStartSLOduration=1.297248194 podStartE2EDuration="15.53089673s" totalImagesPullingTime="14.233648536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:38.529947305 +0000 UTC m=+154.214196530" watchObservedRunningTime="2026-07-15 16:39:38.53089673 +0000 UTC m=+154.215145956" Jul 15 16:39:38.555537 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.554875 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-w28wt" podStartSLOduration=1.526521054 podStartE2EDuration="20.55484986s" totalImagesPullingTime="19.028328806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:38.553299411 +0000 UTC m=+154.237548652" watchObservedRunningTime="2026-07-15 16:39:38.55484986 +0000 UTC m=+154.239099088" Jul 15 16:39:38.584361 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.584270 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:38.736365 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.736332 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 16:39:38.742177 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.742149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.744893 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.744867 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 16:39:38.745411 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.745228 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 16:39:38.746011 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.745668 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 16:39:38.746444 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.746352 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ff3gmue8i6ch\"" Jul 15 16:39:38.746533 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.746462 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 16:39:38.746594 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.746532 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 16:39:38.746886 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.746864 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 16:39:38.746886 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.746908 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x8962\"" Jul 15 16:39:38.747111 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.747078 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 16:39:38.747188 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.747125 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 16:39:38.747281 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.747266 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 16:39:38.747353 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.747333 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 16:39:38.747646 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.747533 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 16:39:38.747646 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.747562 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 16:39:38.767511 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.767472 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 16:39:38.768353 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.768267 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 16:39:38.769807 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.769364 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 16:39:38.771762 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.771732 2565 patch_prober.go:28] interesting pod/image-registry-5c9cf75b96-8t5b9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 16:39:38.771921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.771794 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" podUID="7e447b54-0c14-43c9-bc11-46f83e676f4e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 16:39:38.779801 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.779699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8465bf4648-fgg8c"] Jul 15 16:39:38.782423 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:38.782392 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37199c66_3117_4ee8_af1e_220323fc8e7e.slice/crio-ace85332359f69c7643d175024f72b615fa3bb8368028c34b931d1deebd804c7 WatchSource:0}: Error finding container ace85332359f69c7643d175024f72b615fa3bb8368028c34b931d1deebd804c7: Status 404 returned error can't find the container with id ace85332359f69c7643d175024f72b615fa3bb8368028c34b931d1deebd804c7 Jul 15 16:39:38.862001 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.861964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.862256 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.862234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.862422 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.862406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.862587 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.862571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.862790 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.862767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9897e34d-d306-4f39-8e27-dcf20f2a6aee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.862864 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.862850 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9897e34d-d306-4f39-8e27-dcf20f2a6aee-config-out\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.862941 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.862923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.862995 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.862954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863082 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863039 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863139 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863194 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-config\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863244 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863303 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863357 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863407 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863459 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863512 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863512 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbpx\" (UniqueName: \"kubernetes.io/projected/9897e34d-d306-4f39-8e27-dcf20f2a6aee-kube-api-access-vkbpx\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863609 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-web-config\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.863609 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.863573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965088 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.964924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965088 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.964978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-config\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965088 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965414 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbpx\" (UniqueName: \"kubernetes.io/projected/9897e34d-d306-4f39-8e27-dcf20f2a6aee-kube-api-access-vkbpx\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-web-config\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.965677 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965664 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.966217 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966138 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.966270 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966248 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.965668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966565 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9897e34d-d306-4f39-8e27-dcf20f2a6aee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9897e34d-d306-4f39-8e27-dcf20f2a6aee-config-out\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.967238 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.966808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.969872 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.968037 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.969872 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.968882 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.969872 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.969265 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.969872 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.969540 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9897e34d-d306-4f39-8e27-dcf20f2a6aee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.977436 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.977105 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9897e34d-d306-4f39-8e27-dcf20f2a6aee-config-out\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.977436 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.977256 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbpx\" (UniqueName: \"kubernetes.io/projected/9897e34d-d306-4f39-8e27-dcf20f2a6aee-kube-api-access-vkbpx\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.977436 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.977415 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.977733 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.977704 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.977867 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.977778 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.978191 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.978148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-web-config\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.978527 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.978473 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.979581 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.979039 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-config\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.979581 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.979236 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9897e34d-d306-4f39-8e27-dcf20f2a6aee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.979581 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.979545 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.981423 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.981390 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:38.981981 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:38.981958 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9897e34d-d306-4f39-8e27-dcf20f2a6aee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9897e34d-d306-4f39-8e27-dcf20f2a6aee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:39.073801 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:39.073567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:39.494651 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:39.494549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465bf4648-fgg8c" event={"ID":"37199c66-3117-4ee8-af1e-220323fc8e7e","Type":"ContainerStarted","Data":"6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8"} Jul 15 16:39:39.494651 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:39.494612 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465bf4648-fgg8c" event={"ID":"37199c66-3117-4ee8-af1e-220323fc8e7e","Type":"ContainerStarted","Data":"ace85332359f69c7643d175024f72b615fa3bb8368028c34b931d1deebd804c7"} Jul 15 16:39:39.517270 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:39.517192 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8465bf4648-fgg8c" podStartSLOduration=1.5171671039999999 podStartE2EDuration="1.517167104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:39.516672022 +0000 UTC m=+155.200921272" watchObservedRunningTime="2026-07-15 16:39:39.517167104 +0000 UTC m=+155.201416332" Jul 15 16:39:39.611544 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:39.610943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 16:39:40.503153 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:40.503033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerStarted","Data":"ae0cb1d2d1dcd52923b052855ffd0473f85c00f3bd3a3af785651428c69fa7cd"} Jul 15 16:39:40.509617 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:40.508211 2565 generic.go:356] "Generic (PLEG): container finished" podID="a02fffb1-68a8-48bd-be4e-9770ea034dab" containerID="2565070c809d5404094ab697ff9370e1c5aa5f3af55c4553619cf16509c203b5" exitCode=0 Jul 15 16:39:40.509617 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:40.509073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9chzs" event={"ID":"a02fffb1-68a8-48bd-be4e-9770ea034dab","Type":"ContainerDied","Data":"2565070c809d5404094ab697ff9370e1c5aa5f3af55c4553619cf16509c203b5"} Jul 15 16:39:42.680660 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:39:42.680604 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wrl48" podUID="261fea66-f664-4622-93ce-2e5bfcf6d5b4" Jul 15 16:39:43.523448 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:43.523414 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wrl48" Jul 15 16:39:43.695824 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:43.695739 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:39:43.778668 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:43.778609 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" podUID="7e447b54-0c14-43c9-bc11-46f83e676f4e" containerName="registry" containerID="cri-o://548a49256ad7b04e0b2bc3482b7eecb8c0246c1f0fdc6ab4e684a838f6b7582f" gracePeriod=30 Jul 15 16:39:44.534965 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:44.534924 2565 generic.go:356] "Generic (PLEG): container finished" podID="7e447b54-0c14-43c9-bc11-46f83e676f4e" containerID="548a49256ad7b04e0b2bc3482b7eecb8c0246c1f0fdc6ab4e684a838f6b7582f" exitCode=0 Jul 15 16:39:44.535140 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:44.534979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" event={"ID":"7e447b54-0c14-43c9-bc11-46f83e676f4e","Type":"ContainerDied","Data":"548a49256ad7b04e0b2bc3482b7eecb8c0246c1f0fdc6ab4e684a838f6b7582f"} Jul 15 16:39:45.258352 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.258268 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:39:45.340668 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340628 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-certificates\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.340873 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340694 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-bound-sa-token\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.340873 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340739 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6x52\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-kube-api-access-l6x52\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.340873 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340789 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-image-registry-private-configuration\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.340873 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340826 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-trusted-ca\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.340873 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340857 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-installation-pull-secrets\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.341168 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340907 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.341168 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.340959 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e447b54-0c14-43c9-bc11-46f83e676f4e-ca-trust-extracted\") pod \"7e447b54-0c14-43c9-bc11-46f83e676f4e\" (UID: \"7e447b54-0c14-43c9-bc11-46f83e676f4e\") " Jul 15 16:39:45.341273 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.341166 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:39:45.341357 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.341332 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-certificates\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.341554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.341522 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:39:45.344411 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.343981 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-kube-api-access-l6x52" (OuterVolumeSpecName: "kube-api-access-l6x52") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "kube-api-access-l6x52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:39:45.344411 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.344118 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:39:45.344411 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.344359 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:39:45.345119 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.345087 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:39:45.345668 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.345642 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:39:45.352365 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.352332 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e447b54-0c14-43c9-bc11-46f83e676f4e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7e447b54-0c14-43c9-bc11-46f83e676f4e" (UID: "7e447b54-0c14-43c9-bc11-46f83e676f4e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:39:45.441878 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.441835 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-installation-pull-secrets\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.442097 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.441874 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-registry-tls\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.442097 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.442080 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e447b54-0c14-43c9-bc11-46f83e676f4e-ca-trust-extracted\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.442229 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.442099 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-bound-sa-token\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.442229 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.442115 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6x52\" (UniqueName: \"kubernetes.io/projected/7e447b54-0c14-43c9-bc11-46f83e676f4e-kube-api-access-l6x52\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.442229 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.442131 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e447b54-0c14-43c9-bc11-46f83e676f4e-image-registry-private-configuration\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.442229 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.442149 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e447b54-0c14-43c9-bc11-46f83e676f4e-trusted-ca\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:39:45.540855 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.540821 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" Jul 15 16:39:45.541026 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.540863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9cf75b96-8t5b9" event={"ID":"7e447b54-0c14-43c9-bc11-46f83e676f4e","Type":"ContainerDied","Data":"13bb27e9b8fbcf100e7db9066b0d497092fc852c316419efd7fc020d3df177cd"} Jul 15 16:39:45.541026 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.540962 2565 scope.go:117] "RemoveContainer" containerID="548a49256ad7b04e0b2bc3482b7eecb8c0246c1f0fdc6ab4e684a838f6b7582f" Jul 15 16:39:45.570566 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.570515 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c9cf75b96-8t5b9"] Jul 15 16:39:45.572746 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:45.572708 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c9cf75b96-8t5b9"] Jul 15 16:39:46.550155 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.549947 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9chzs" event={"ID":"a02fffb1-68a8-48bd-be4e-9770ea034dab","Type":"ContainerStarted","Data":"2ee1dfe8b7ddaca2ffea19b30af0a799bcea3e314bdcbc319f2f0a77473969fe"} Jul 15 16:39:46.550155 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.550011 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9chzs" event={"ID":"a02fffb1-68a8-48bd-be4e-9770ea034dab","Type":"ContainerStarted","Data":"be140a9742eea9efda443bbf63d2a625510e9fbe38c04a50e305351140cd78ff"} Jul 15 16:39:46.559272 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.559240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txp5c" event={"ID":"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24","Type":"ContainerStarted","Data":"6617451ca7c9e79b3e42ab9e8420d3b4c4c44c5d8fbd760872505dd71d50d1cb"} Jul 15 16:39:46.564997 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.564390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" event={"ID":"0d5115b9-d105-4b63-8d63-286e4b370c6c","Type":"ContainerStarted","Data":"0d7387331750a011d0919cdad34b40b2104e0d9ec6c9a4a0b1863dbdfa9c2c61"} Jul 15 16:39:46.564997 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.564447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" event={"ID":"0d5115b9-d105-4b63-8d63-286e4b370c6c","Type":"ContainerStarted","Data":"07536dc181dcab1ed6ee010fdd68b30d687b7cbc75bcf58718be133e193ae00f"} Jul 15 16:39:46.564997 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.564478 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" event={"ID":"0d5115b9-d105-4b63-8d63-286e4b370c6c","Type":"ContainerStarted","Data":"ab715eae880d837a9e49c4f26fbcdd7060acb212349f5a5cf4dafd5f709673ea"} Jul 15 16:39:46.567452 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.567229 2565 generic.go:356] "Generic (PLEG): container finished" podID="9897e34d-d306-4f39-8e27-dcf20f2a6aee" containerID="a02f0fbd08d4246ded4791e69d52a7d77455ecb3b1de3f5a038f397690067430" exitCode=0 Jul 15 16:39:46.567452 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.567311 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerDied","Data":"a02f0fbd08d4246ded4791e69d52a7d77455ecb3b1de3f5a038f397690067430"} Jul 15 16:39:46.573315 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.572851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" event={"ID":"11f7d913-c732-40b1-98c5-d70d23995305","Type":"ContainerStarted","Data":"181a8d3a15bc116e9d27517b6dbc45d39e68439b386598db47609a606b8bbac1"} Jul 15 16:39:46.613271 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.613208 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9chzs" podStartSLOduration=13.19020415 podStartE2EDuration="14.613182473s" totalImagesPullingTime="1.299346047s" totalInitContainerRuntime="123.632276ms" isStatefulPod=true podCreationTimestamp="2026-07-15 16:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:46.580330632 +0000 UTC m=+162.264579858" watchObservedRunningTime="2026-07-15 16:39:46.613182473 +0000 UTC m=+162.297431700" Jul 15 16:39:46.637236 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.636986 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" podStartSLOduration=3.977663781 podStartE2EDuration="10.636963645s" totalImagesPullingTime="6.659299864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:46.636455482 +0000 UTC m=+162.320704706" watchObservedRunningTime="2026-07-15 16:39:46.636963645 +0000 UTC m=+162.321212875" Jul 15 16:39:46.900705 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:46.900609 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e447b54-0c14-43c9-bc11-46f83e676f4e" path="/var/lib/kubelet/pods/7e447b54-0c14-43c9-bc11-46f83e676f4e/volumes" Jul 15 16:39:47.668396 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:47.668354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:39:47.674256 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:47.674221 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261fea66-f664-4622-93ce-2e5bfcf6d5b4-metrics-tls\") pod \"dns-default-wrl48\" (UID: \"261fea66-f664-4622-93ce-2e5bfcf6d5b4\") " pod="openshift-dns/dns-default-wrl48" Jul 15 16:39:47.726540 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:47.726509 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hj6qd\"" Jul 15 16:39:47.734511 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:47.734486 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wrl48" Jul 15 16:39:47.904640 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:47.904566 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-bq4rh" podStartSLOduration=9.645761939 podStartE2EDuration="15.904545315s" totalImagesPullingTime="6.258783376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:46.666637868 +0000 UTC m=+162.350887093" watchObservedRunningTime="2026-07-15 16:39:47.904545315 +0000 UTC m=+163.588794544" Jul 15 16:39:47.906585 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:47.906523 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wrl48"] Jul 15 16:39:48.585434 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:48.585175 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:48.585434 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:48.585244 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:48.587117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:48.587089 2565 patch_prober.go:28] interesting pod/console-8465bf4648-fgg8c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jul 15 16:39:48.587261 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:48.587140 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8465bf4648-fgg8c" podUID="37199c66-3117-4ee8-af1e-220323fc8e7e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jul 15 16:39:49.871059 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:39:49.871008 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261fea66_f664_4622_93ce_2e5bfcf6d5b4.slice/crio-7d6a7ab7dd6af17d8397d8712ba47f51fbe95e88f911ca6f72d2519ea4b43706 WatchSource:0}: Error finding container 7d6a7ab7dd6af17d8397d8712ba47f51fbe95e88f911ca6f72d2519ea4b43706: Status 404 returned error can't find the container with id 7d6a7ab7dd6af17d8397d8712ba47f51fbe95e88f911ca6f72d2519ea4b43706 Jul 15 16:39:50.599496 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:50.599453 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrl48" event={"ID":"261fea66-f664-4622-93ce-2e5bfcf6d5b4","Type":"ContainerStarted","Data":"7d6a7ab7dd6af17d8397d8712ba47f51fbe95e88f911ca6f72d2519ea4b43706"} Jul 15 16:39:51.607099 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:51.607060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txp5c" event={"ID":"2be53ffe-4f8b-4bef-a2e7-6e2764c38b24","Type":"ContainerStarted","Data":"d2d40d9285fe5a2795e9c021d4392bfb197f17e4105d06738c1d78bad35ef56d"} Jul 15 16:39:51.610620 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:51.610582 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerStarted","Data":"8146001b9d95bf7a7a9d25301a45921923c55740fd48bb92228dbb65e571e13d"} Jul 15 16:39:52.617011 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:52.616970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerStarted","Data":"737828a3797edcaac02410e0054d59e9ac445136a1008f656e00f62f8d7c0835"} Jul 15 16:39:54.627578 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.627541 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrl48" event={"ID":"261fea66-f664-4622-93ce-2e5bfcf6d5b4","Type":"ContainerStarted","Data":"c042545a17c5140dfec3a5bc92f0cd71f93abf15be07a8083d449f81dbeef68b"} Jul 15 16:39:54.628065 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.627609 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wrl48" Jul 15 16:39:54.628065 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.627636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrl48" event={"ID":"261fea66-f664-4622-93ce-2e5bfcf6d5b4","Type":"ContainerStarted","Data":"78d4b5b6fd3f1bb96ad5ae0ec8f9ae572f8534200ab6abbbb85d213cf0b66f25"} Jul 15 16:39:54.630926 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.630901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerStarted","Data":"086f8adf081020e84660405195c88457e4e32f5d550f6d6ca6c1ec089e87af09"} Jul 15 16:39:54.631090 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.630957 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerStarted","Data":"4613f2b93a15d576326d13333eabaabd56d35d55887148b573804ab5f5fd2613"} Jul 15 16:39:54.631090 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.630984 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerStarted","Data":"25b8b85ae27b767a6277ab74e1f3b33330556757d3adbd9ea8efc55644f95686"} Jul 15 16:39:54.631090 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.631028 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9897e34d-d306-4f39-8e27-dcf20f2a6aee","Type":"ContainerStarted","Data":"6b9bdec1a84fdd1ffee6ebf1b4b449fc2b0de36e12fa4818b380d9691b8c6129"} Jul 15 16:39:54.647360 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.647276 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wrl48" podStartSLOduration=131.662040555 podStartE2EDuration="2m15.647260966s" totalImagesPullingTime="3.985220411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:54.646549607 +0000 UTC m=+170.330798871" watchObservedRunningTime="2026-07-15 16:39:54.647260966 +0000 UTC m=+170.331510191" Jul 15 16:39:54.647663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.647634 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-txp5c" podStartSLOduration=36.624305813 podStartE2EDuration="1m2.647624426s" totalImagesPullingTime="26.023318613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:38:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:51.634360213 +0000 UTC m=+167.318609440" watchObservedRunningTime="2026-07-15 16:39:54.647624426 +0000 UTC m=+170.331873651" Jul 15 16:39:54.680336 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:54.679971 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.470699449 podStartE2EDuration="16.679949018s" totalImagesPullingTime="13.164280417s" totalInitContainerRuntime="44.969152ms" isStatefulPod=false podCreationTimestamp="2026-07-15 16:39:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:39:54.677317573 +0000 UTC m=+170.361566798" watchObservedRunningTime="2026-07-15 16:39:54.679949018 +0000 UTC m=+170.364198244" Jul 15 16:39:57.238768 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:57.238679 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:57.238768 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:57.238741 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:39:58.589287 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:58.589257 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:58.593210 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:58.593188 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:39:59.074094 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:59.074065 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:39:59.654855 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:59.654818 2565 generic.go:356] "Generic (PLEG): container finished" podID="4c3c3421-39b0-4cee-8ddb-741f8a534108" containerID="f0f61a50644bb37af55ce4883fea2f0d090df315ee41bf6b9a5a5247131f4894" exitCode=0 Jul 15 16:39:59.655241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:59.654868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" event={"ID":"4c3c3421-39b0-4cee-8ddb-741f8a534108","Type":"ContainerDied","Data":"f0f61a50644bb37af55ce4883fea2f0d090df315ee41bf6b9a5a5247131f4894"} Jul 15 16:39:59.655241 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:39:59.655227 2565 scope.go:117] "RemoveContainer" containerID="f0f61a50644bb37af55ce4883fea2f0d090df315ee41bf6b9a5a5247131f4894" Jul 15 16:40:00.663823 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:00.663787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qz6dp" event={"ID":"4c3c3421-39b0-4cee-8ddb-741f8a534108","Type":"ContainerStarted","Data":"966bffc9988019d77459f6618443c6194344299cd569a200a488337fec0609dc"} Jul 15 16:40:03.501743 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.501696 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b5c5596f6-xfnqt" podUID="1ce1e0fd-1413-490d-b185-0dbf8323e05f" containerName="console" containerID="cri-o://87487c4697e1c3419e7f2e5e3a9a11c188a93b6a6358d7644361773855be718c" gracePeriod=15 Jul 15 16:40:03.678769 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.678730 2565 generic.go:356] "Generic (PLEG): container finished" podID="1ce1e0fd-1413-490d-b185-0dbf8323e05f" containerID="87487c4697e1c3419e7f2e5e3a9a11c188a93b6a6358d7644361773855be718c" exitCode=0 Jul 15 16:40:03.678936 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.678799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5c5596f6-xfnqt" event={"ID":"1ce1e0fd-1413-490d-b185-0dbf8323e05f","Type":"ContainerDied","Data":"87487c4697e1c3419e7f2e5e3a9a11c188a93b6a6358d7644361773855be718c"} Jul 15 16:40:03.775773 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.775699 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:40:03.921886 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.921846 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j558m\" (UniqueName: \"kubernetes.io/projected/1ce1e0fd-1413-490d-b185-0dbf8323e05f-kube-api-access-j558m\") pod \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " Jul 15 16:40:03.921886 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.921892 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-oauth-config\") pod \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " Jul 15 16:40:03.922147 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.921926 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-serving-cert\") pod \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " Jul 15 16:40:03.922147 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.921969 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-service-ca\") pod \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " Jul 15 16:40:03.922147 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.922051 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-config\") pod \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " Jul 15 16:40:03.922147 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.922095 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-oauth-serving-cert\") pod \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\" (UID: \"1ce1e0fd-1413-490d-b185-0dbf8323e05f\") " Jul 15 16:40:03.922514 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.922481 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-config" (OuterVolumeSpecName: "console-config") pod "1ce1e0fd-1413-490d-b185-0dbf8323e05f" (UID: "1ce1e0fd-1413-490d-b185-0dbf8323e05f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:40:03.922618 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.922489 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ce1e0fd-1413-490d-b185-0dbf8323e05f" (UID: "1ce1e0fd-1413-490d-b185-0dbf8323e05f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:40:03.922618 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.922524 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ce1e0fd-1413-490d-b185-0dbf8323e05f" (UID: "1ce1e0fd-1413-490d-b185-0dbf8323e05f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:40:03.924386 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.924351 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ce1e0fd-1413-490d-b185-0dbf8323e05f" (UID: "1ce1e0fd-1413-490d-b185-0dbf8323e05f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:40:03.924498 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.924424 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ce1e0fd-1413-490d-b185-0dbf8323e05f" (UID: "1ce1e0fd-1413-490d-b185-0dbf8323e05f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:40:03.924498 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:03.924453 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce1e0fd-1413-490d-b185-0dbf8323e05f-kube-api-access-j558m" (OuterVolumeSpecName: "kube-api-access-j558m") pod "1ce1e0fd-1413-490d-b185-0dbf8323e05f" (UID: "1ce1e0fd-1413-490d-b185-0dbf8323e05f"). InnerVolumeSpecName "kube-api-access-j558m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:40:04.023099 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.023059 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-oauth-serving-cert\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:40:04.023099 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.023090 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j558m\" (UniqueName: \"kubernetes.io/projected/1ce1e0fd-1413-490d-b185-0dbf8323e05f-kube-api-access-j558m\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:40:04.023099 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.023102 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-oauth-config\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:40:04.023099 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.023110 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-serving-cert\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:40:04.023383 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.023121 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-service-ca\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:40:04.023383 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.023129 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ce1e0fd-1413-490d-b185-0dbf8323e05f-console-config\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:40:04.638067 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.638012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wrl48" Jul 15 16:40:04.686753 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.686724 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5c5596f6-xfnqt" Jul 15 16:40:04.686928 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.686722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5c5596f6-xfnqt" event={"ID":"1ce1e0fd-1413-490d-b185-0dbf8323e05f","Type":"ContainerDied","Data":"14248390ed13e4f353c9912c0e5b962cbb6910f461b98392ed46c49332496179"} Jul 15 16:40:04.686928 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.686872 2565 scope.go:117] "RemoveContainer" containerID="87487c4697e1c3419e7f2e5e3a9a11c188a93b6a6358d7644361773855be718c" Jul 15 16:40:04.738481 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.738441 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5c5596f6-xfnqt"] Jul 15 16:40:04.750717 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.750689 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b5c5596f6-xfnqt"] Jul 15 16:40:04.901354 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:04.901280 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce1e0fd-1413-490d-b185-0dbf8323e05f" path="/var/lib/kubelet/pods/1ce1e0fd-1413-490d-b185-0dbf8323e05f/volumes" Jul 15 16:40:17.243718 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:17.243681 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:40:17.247676 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:17.247652 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-778f7fffd9-fjc5p" Jul 15 16:40:23.728240 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:23.728189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8d5nb_57543dc7-126e-4692-ac17-a891fb0e71b2/serve-healthcheck-canary/0.log" Jul 15 16:40:25.764945 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:25.764914 2565 generic.go:356] "Generic (PLEG): container finished" podID="588c8e96-a074-4426-bb72-5d5aac6abc91" containerID="4ac2617d853b0b7cf4a2c2772e1cbaed543101d5317d1cb84459f80d03fc1a46" exitCode=0 Jul 15 16:40:25.765381 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:25.764967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" event={"ID":"588c8e96-a074-4426-bb72-5d5aac6abc91","Type":"ContainerDied","Data":"4ac2617d853b0b7cf4a2c2772e1cbaed543101d5317d1cb84459f80d03fc1a46"} Jul 15 16:40:25.765381 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:25.765272 2565 scope.go:117] "RemoveContainer" containerID="4ac2617d853b0b7cf4a2c2772e1cbaed543101d5317d1cb84459f80d03fc1a46" Jul 15 16:40:26.770632 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:26.770596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-pjtpq" event={"ID":"588c8e96-a074-4426-bb72-5d5aac6abc91","Type":"ContainerStarted","Data":"ee0bbe05e1a830f8662791d21ed7c23a7411f9507a09b039528d3c465b272a02"} Jul 15 16:40:39.074582 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:39.074547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:40:39.094077 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:39.094054 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:40:39.842975 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:40:39.842945 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 16:41:10.898621 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.898590 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68b9c4c45-cshp6"] Jul 15 16:41:10.899101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.898851 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce1e0fd-1413-490d-b185-0dbf8323e05f" containerName="console" Jul 15 16:41:10.899101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.898861 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce1e0fd-1413-490d-b185-0dbf8323e05f" containerName="console" Jul 15 16:41:10.899101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.898871 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e447b54-0c14-43c9-bc11-46f83e676f4e" containerName="registry" Jul 15 16:41:10.899101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.898876 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e447b54-0c14-43c9-bc11-46f83e676f4e" containerName="registry" Jul 15 16:41:10.899101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.898928 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce1e0fd-1413-490d-b185-0dbf8323e05f" containerName="console" Jul 15 16:41:10.899101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.898935 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e447b54-0c14-43c9-bc11-46f83e676f4e" containerName="registry" Jul 15 16:41:10.900827 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.900809 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:10.910766 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.910743 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b9c4c45-cshp6"] Jul 15 16:41:10.916527 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.916505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5lm7\" (UniqueName: \"kubernetes.io/projected/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-kube-api-access-f5lm7\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:10.916643 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.916540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-oauth-config\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:10.916643 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.916580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-service-ca\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:10.916748 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.916684 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-oauth-serving-cert\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:10.916748 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.916703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-config\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:10.916748 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.916732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-serving-cert\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:10.916918 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:10.916765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-trusted-ca-bundle\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.017402 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.017355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-config\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.017595 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.017507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-serving-cert\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.017595 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.017559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-trusted-ca-bundle\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.017595 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.017592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5lm7\" (UniqueName: \"kubernetes.io/projected/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-kube-api-access-f5lm7\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.017757 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.017620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-oauth-config\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.017757 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.017672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-service-ca\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.017757 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.017709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-oauth-serving-cert\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.018211 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.018177 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-config\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.018466 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.018443 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-oauth-serving-cert\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.018554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.018507 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-trusted-ca-bundle\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.018554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.018533 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-service-ca\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.020156 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.020133 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-serving-cert\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.020247 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.020163 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-oauth-config\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.026779 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.026752 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5lm7\" (UniqueName: \"kubernetes.io/projected/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-kube-api-access-f5lm7\") pod \"console-68b9c4c45-cshp6\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.210765 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.210659 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:11.347087 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.347061 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b9c4c45-cshp6"] Jul 15 16:41:11.349603 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:41:11.349575 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec97b2b0_e0ae_400f_b66c_4a64dae9ff0b.slice/crio-69db510c1065ef6242d45a6c645ce78933622c005f081a91df6d31b6d619442d WatchSource:0}: Error finding container 69db510c1065ef6242d45a6c645ce78933622c005f081a91df6d31b6d619442d: Status 404 returned error can't find the container with id 69db510c1065ef6242d45a6c645ce78933622c005f081a91df6d31b6d619442d Jul 15 16:41:11.948953 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.948917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9c4c45-cshp6" event={"ID":"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b","Type":"ContainerStarted","Data":"12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82"} Jul 15 16:41:11.949393 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.948971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9c4c45-cshp6" event={"ID":"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b","Type":"ContainerStarted","Data":"69db510c1065ef6242d45a6c645ce78933622c005f081a91df6d31b6d619442d"} Jul 15 16:41:11.969642 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:11.969585 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68b9c4c45-cshp6" podStartSLOduration=1.969564868 podStartE2EDuration="1.969564868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:41:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:41:11.96875179 +0000 UTC m=+247.653001041" watchObservedRunningTime="2026-07-15 16:41:11.969564868 +0000 UTC m=+247.653814094" Jul 15 16:41:21.211776 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:21.211730 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:21.212300 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:21.211817 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:21.216561 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:21.216536 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:21.991746 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:21.991717 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:41:22.047404 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:22.047370 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8465bf4648-fgg8c"] Jul 15 16:41:47.069103 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.069037 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8465bf4648-fgg8c" podUID="37199c66-3117-4ee8-af1e-220323fc8e7e" containerName="console" containerID="cri-o://6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8" gracePeriod=15 Jul 15 16:41:47.317220 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.317198 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:41:47.444097 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.443985 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-service-ca\") pod \"37199c66-3117-4ee8-af1e-220323fc8e7e\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " Jul 15 16:41:47.444097 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444069 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-serving-cert\") pod \"37199c66-3117-4ee8-af1e-220323fc8e7e\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " Jul 15 16:41:47.444277 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444231 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-oauth-config\") pod \"37199c66-3117-4ee8-af1e-220323fc8e7e\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " Jul 15 16:41:47.444314 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444292 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-oauth-serving-cert\") pod \"37199c66-3117-4ee8-af1e-220323fc8e7e\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " Jul 15 16:41:47.444351 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444314 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78vbj\" (UniqueName: \"kubernetes.io/projected/37199c66-3117-4ee8-af1e-220323fc8e7e-kube-api-access-78vbj\") pod \"37199c66-3117-4ee8-af1e-220323fc8e7e\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " Jul 15 16:41:47.444351 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444335 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-trusted-ca-bundle\") pod \"37199c66-3117-4ee8-af1e-220323fc8e7e\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " Jul 15 16:41:47.444433 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444377 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "37199c66-3117-4ee8-af1e-220323fc8e7e" (UID: "37199c66-3117-4ee8-af1e-220323fc8e7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:41:47.444433 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444390 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-console-config\") pod \"37199c66-3117-4ee8-af1e-220323fc8e7e\" (UID: \"37199c66-3117-4ee8-af1e-220323fc8e7e\") " Jul 15 16:41:47.444811 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444749 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37199c66-3117-4ee8-af1e-220323fc8e7e" (UID: "37199c66-3117-4ee8-af1e-220323fc8e7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:41:47.444811 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444766 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37199c66-3117-4ee8-af1e-220323fc8e7e" (UID: "37199c66-3117-4ee8-af1e-220323fc8e7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:41:47.444811 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444780 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-console-config" (OuterVolumeSpecName: "console-config") pod "37199c66-3117-4ee8-af1e-220323fc8e7e" (UID: "37199c66-3117-4ee8-af1e-220323fc8e7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:41:47.445084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.444824 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-service-ca\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:41:47.446233 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.446206 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37199c66-3117-4ee8-af1e-220323fc8e7e" (UID: "37199c66-3117-4ee8-af1e-220323fc8e7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:41:47.446358 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.446285 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37199c66-3117-4ee8-af1e-220323fc8e7e" (UID: "37199c66-3117-4ee8-af1e-220323fc8e7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:41:47.446530 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.446507 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37199c66-3117-4ee8-af1e-220323fc8e7e-kube-api-access-78vbj" (OuterVolumeSpecName: "kube-api-access-78vbj") pod "37199c66-3117-4ee8-af1e-220323fc8e7e" (UID: "37199c66-3117-4ee8-af1e-220323fc8e7e"). InnerVolumeSpecName "kube-api-access-78vbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:41:47.545756 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.545722 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-serving-cert\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:41:47.545756 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.545749 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37199c66-3117-4ee8-af1e-220323fc8e7e-console-oauth-config\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:41:47.545756 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.545759 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-oauth-serving-cert\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:41:47.545974 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.545768 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78vbj\" (UniqueName: \"kubernetes.io/projected/37199c66-3117-4ee8-af1e-220323fc8e7e-kube-api-access-78vbj\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:41:47.545974 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.545779 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-trusted-ca-bundle\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:41:47.545974 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:47.545789 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37199c66-3117-4ee8-af1e-220323fc8e7e-console-config\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:41:48.090052 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.090002 2565 generic.go:356] "Generic (PLEG): container finished" podID="37199c66-3117-4ee8-af1e-220323fc8e7e" containerID="6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8" exitCode=0 Jul 15 16:41:48.090052 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.090058 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8465bf4648-fgg8c" Jul 15 16:41:48.090511 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.090078 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465bf4648-fgg8c" event={"ID":"37199c66-3117-4ee8-af1e-220323fc8e7e","Type":"ContainerDied","Data":"6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8"} Jul 15 16:41:48.090511 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.090119 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8465bf4648-fgg8c" event={"ID":"37199c66-3117-4ee8-af1e-220323fc8e7e","Type":"ContainerDied","Data":"ace85332359f69c7643d175024f72b615fa3bb8368028c34b931d1deebd804c7"} Jul 15 16:41:48.090511 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.090138 2565 scope.go:117] "RemoveContainer" containerID="6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8" Jul 15 16:41:48.098869 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.098852 2565 scope.go:117] "RemoveContainer" containerID="6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8" Jul 15 16:41:48.099147 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:41:48.099128 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8\": container with ID starting with 6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8 not found: ID does not exist" containerID="6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8" Jul 15 16:41:48.099203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.099158 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8"} err="failed to get container status \"6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8\": rpc error: code = NotFound desc = could not find container \"6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8\": container with ID starting with 6b849ec82c7e998583eaa254f7b199d1057d5d11785b85b017626de76c7a38c8 not found: ID does not exist" Jul 15 16:41:48.112354 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.112330 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8465bf4648-fgg8c"] Jul 15 16:41:48.116948 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.116925 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8465bf4648-fgg8c"] Jul 15 16:41:48.898519 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:41:48.898489 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37199c66-3117-4ee8-af1e-220323fc8e7e" path="/var/lib/kubelet/pods/37199c66-3117-4ee8-af1e-220323fc8e7e/volumes" Jul 15 16:42:04.759761 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:04.759733 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:42:04.760346 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:04.759738 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:42:04.768537 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:04.768506 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:42:04.768716 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:04.768508 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:42:04.772189 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:04.772167 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 16:42:50.637652 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.637614 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkh9b"] Jul 15 16:42:50.638117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.637908 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37199c66-3117-4ee8-af1e-220323fc8e7e" containerName="console" Jul 15 16:42:50.638117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.637919 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37199c66-3117-4ee8-af1e-220323fc8e7e" containerName="console" Jul 15 16:42:50.638117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.637986 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37199c66-3117-4ee8-af1e-220323fc8e7e" containerName="console" Jul 15 16:42:50.640931 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.640913 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:50.644571 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.644550 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-s5mkm\"" Jul 15 16:42:50.646405 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.646383 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 16:42:50.647631 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.647296 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 16:42:50.674482 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.674445 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkh9b"] Jul 15 16:42:50.694287 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.694253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkh9b\" (UID: \"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:50.694448 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.694303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxgxp\" (UniqueName: \"kubernetes.io/projected/ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6-kube-api-access-sxgxp\") pod \"cert-manager-webhook-6486ffd997-vkh9b\" (UID: \"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:50.795703 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.795668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxgxp\" (UniqueName: \"kubernetes.io/projected/ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6-kube-api-access-sxgxp\") pod \"cert-manager-webhook-6486ffd997-vkh9b\" (UID: \"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:50.795914 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.795837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkh9b\" (UID: \"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:50.805463 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.805440 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxgxp\" (UniqueName: \"kubernetes.io/projected/ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6-kube-api-access-sxgxp\") pod \"cert-manager-webhook-6486ffd997-vkh9b\" (UID: \"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:50.808314 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.808289 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkh9b\" (UID: \"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:50.950718 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:50.950627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:51.082626 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:51.082603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkh9b"] Jul 15 16:42:51.084999 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:42:51.084972 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce59e811_01a1_4c65_b4b2_4cebb5b8f1f6.slice/crio-96bebdb8a9b2edc382fdfb5f413de695ecfeb67f33dd8ae0d77f4dfd1ca18fed WatchSource:0}: Error finding container 96bebdb8a9b2edc382fdfb5f413de695ecfeb67f33dd8ae0d77f4dfd1ca18fed: Status 404 returned error can't find the container with id 96bebdb8a9b2edc382fdfb5f413de695ecfeb67f33dd8ae0d77f4dfd1ca18fed Jul 15 16:42:51.086941 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:51.086925 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:42:51.331862 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:51.331820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" event={"ID":"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6","Type":"ContainerStarted","Data":"96bebdb8a9b2edc382fdfb5f413de695ecfeb67f33dd8ae0d77f4dfd1ca18fed"} Jul 15 16:42:54.346960 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:54.346924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" event={"ID":"ce59e811-01a1-4c65-b4b2-4cebb5b8f1f6","Type":"ContainerStarted","Data":"57107eb4ec61734a7bf3024cd0412fd818311d50af55f92a5244d8e9995571e6"} Jul 15 16:42:54.347442 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:54.347029 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:42:54.369489 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:42:54.369432 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" podStartSLOduration=1.280200203 podStartE2EDuration="4.369413445s" totalImagesPullingTime="3.089213242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:54.368155278 +0000 UTC m=+350.052404505" watchObservedRunningTime="2026-07-15 16:42:54.369413445 +0000 UTC m=+350.053662670" Jul 15 16:43:00.353839 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:00.353766 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vkh9b" Jul 15 16:43:23.085576 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.085542 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw"] Jul 15 16:43:23.089689 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.089667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.092898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.092874 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wjh8v\"" Jul 15 16:43:23.094465 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.094437 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 16:43:23.094553 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.094511 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 16:43:23.099111 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.099086 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 16:43:23.110191 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.110167 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 16:43:23.226449 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.226412 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw"] Jul 15 16:43:23.280580 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.280529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c817e08-74d8-4e02-b687-2e8fed4d73b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.280580 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.280588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c817e08-74d8-4e02-b687-2e8fed4d73b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.280874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.280673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c817e08-74d8-4e02-b687-2e8fed4d73b4-manifests\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.280874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.280758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c817e08-74d8-4e02-b687-2e8fed4d73b4-tmp\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.280874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.280801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7wt9\" (UniqueName: \"kubernetes.io/projected/3c817e08-74d8-4e02-b687-2e8fed4d73b4-kube-api-access-x7wt9\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.381926 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.381826 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c817e08-74d8-4e02-b687-2e8fed4d73b4-tmp\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.381926 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.381867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7wt9\" (UniqueName: \"kubernetes.io/projected/3c817e08-74d8-4e02-b687-2e8fed4d73b4-kube-api-access-x7wt9\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.381926 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.381915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c817e08-74d8-4e02-b687-2e8fed4d73b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.382262 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.381939 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c817e08-74d8-4e02-b687-2e8fed4d73b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.382262 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.382115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c817e08-74d8-4e02-b687-2e8fed4d73b4-manifests\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.382477 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.382442 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3c817e08-74d8-4e02-b687-2e8fed4d73b4-manifests\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.384288 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.384256 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c817e08-74d8-4e02-b687-2e8fed4d73b4-tmp\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.384499 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.384482 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3c817e08-74d8-4e02-b687-2e8fed4d73b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.384545 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.384510 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c817e08-74d8-4e02-b687-2e8fed4d73b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.394716 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.394686 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7wt9\" (UniqueName: \"kubernetes.io/projected/3c817e08-74d8-4e02-b687-2e8fed4d73b4-kube-api-access-x7wt9\") pod \"opendatahub-operator-controller-manager-67f48c5d8-m9cqw\" (UID: \"3c817e08-74d8-4e02-b687-2e8fed4d73b4\") " pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.400497 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.400476 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:23.556264 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:43:23.556232 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c817e08_74d8_4e02_b687_2e8fed4d73b4.slice/crio-b1414f584188b9cd757b81dce7c1b4852aaddc59971a2cff251118ec3103fb81 WatchSource:0}: Error finding container b1414f584188b9cd757b81dce7c1b4852aaddc59971a2cff251118ec3103fb81: Status 404 returned error can't find the container with id b1414f584188b9cd757b81dce7c1b4852aaddc59971a2cff251118ec3103fb81 Jul 15 16:43:23.561494 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:23.561468 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw"] Jul 15 16:43:24.462449 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:24.462416 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" event={"ID":"3c817e08-74d8-4e02-b687-2e8fed4d73b4","Type":"ContainerStarted","Data":"b1414f584188b9cd757b81dce7c1b4852aaddc59971a2cff251118ec3103fb81"} Jul 15 16:43:29.486725 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:29.486682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" event={"ID":"3c817e08-74d8-4e02-b687-2e8fed4d73b4","Type":"ContainerStarted","Data":"e7ab496fbf08b0f9a33c565d8ef39e51180009fff97c5c307947f784996c0555"} Jul 15 16:43:30.491989 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:30.491954 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c817e08-74d8-4e02-b687-2e8fed4d73b4" containerID="e7ab496fbf08b0f9a33c565d8ef39e51180009fff97c5c307947f784996c0555" exitCode=0 Jul 15 16:43:30.492388 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:30.492044 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" event={"ID":"3c817e08-74d8-4e02-b687-2e8fed4d73b4","Type":"ContainerDied","Data":"e7ab496fbf08b0f9a33c565d8ef39e51180009fff97c5c307947f784996c0555"} Jul 15 16:43:31.498170 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:31.498128 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" event={"ID":"3c817e08-74d8-4e02-b687-2e8fed4d73b4","Type":"ContainerStarted","Data":"c8435da94a7b292e1a0b681ad9687145f9ca97de090c8248691f8b15f5a50e50"} Jul 15 16:43:31.498562 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:31.498246 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:31.524786 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:31.524731 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" podStartSLOduration=1.964883253 podStartE2EDuration="8.524713315s" totalImagesPullingTime="5.384058708s" totalInitContainerRuntime="1.175771354s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:31.523116111 +0000 UTC m=+387.207365336" watchObservedRunningTime="2026-07-15 16:43:31.524713315 +0000 UTC m=+387.208962541" Jul 15 16:43:42.505715 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:42.505683 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67f48c5d8-m9cqw" Jul 15 16:43:53.564937 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.564899 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg"] Jul 15 16:43:53.573723 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.573699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.576207 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.576186 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 16:43:53.576492 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.576475 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 16:43:53.577084 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.577066 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 16:43:53.577198 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.577181 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 16:43:53.577258 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.577207 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z52t6\"" Jul 15 16:43:53.578198 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.578184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 16:43:53.587537 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.587512 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg"] Jul 15 16:43:53.643448 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.643404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1fecd449-c71d-4fec-95b6-6cf702d54617-manager-config\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.643651 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.643501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fecd449-c71d-4fec-95b6-6cf702d54617-cert\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.643651 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.643604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fecd449-c71d-4fec-95b6-6cf702d54617-metrics-cert\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.643651 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.643625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2vwm\" (UniqueName: \"kubernetes.io/projected/1fecd449-c71d-4fec-95b6-6cf702d54617-kube-api-access-s2vwm\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.744156 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.744126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fecd449-c71d-4fec-95b6-6cf702d54617-cert\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.744335 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.744214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fecd449-c71d-4fec-95b6-6cf702d54617-metrics-cert\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.744335 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.744241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2vwm\" (UniqueName: \"kubernetes.io/projected/1fecd449-c71d-4fec-95b6-6cf702d54617-kube-api-access-s2vwm\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.744335 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.744282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1fecd449-c71d-4fec-95b6-6cf702d54617-manager-config\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.745044 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.745001 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1fecd449-c71d-4fec-95b6-6cf702d54617-manager-config\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.746723 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.746697 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fecd449-c71d-4fec-95b6-6cf702d54617-cert\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.746811 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.746757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fecd449-c71d-4fec-95b6-6cf702d54617-metrics-cert\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.753327 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.753299 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2vwm\" (UniqueName: \"kubernetes.io/projected/1fecd449-c71d-4fec-95b6-6cf702d54617-kube-api-access-s2vwm\") pod \"lws-controller-manager-7cf9875599-7dfvg\" (UID: \"1fecd449-c71d-4fec-95b6-6cf702d54617\") " pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:53.883157 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:53.883068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:43:54.059213 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:54.059183 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg"] Jul 15 16:43:54.061495 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:43:54.061462 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fecd449_c71d_4fec_95b6_6cf702d54617.slice/crio-24f5384925b64aadc2df9f8953432362cbec141a90ffcd49b326b7e31bd0ddfc WatchSource:0}: Error finding container 24f5384925b64aadc2df9f8953432362cbec141a90ffcd49b326b7e31bd0ddfc: Status 404 returned error can't find the container with id 24f5384925b64aadc2df9f8953432362cbec141a90ffcd49b326b7e31bd0ddfc Jul 15 16:43:54.593161 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:54.593126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" event={"ID":"1fecd449-c71d-4fec-95b6-6cf702d54617","Type":"ContainerStarted","Data":"24f5384925b64aadc2df9f8953432362cbec141a90ffcd49b326b7e31bd0ddfc"} Jul 15 16:43:55.459270 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.459235 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446"] Jul 15 16:43:55.462818 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.462789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.465260 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.465234 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 16:43:55.465393 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.465339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 16:43:55.466176 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.466156 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dl8lr\"" Jul 15 16:43:55.466280 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.466207 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 16:43:55.466280 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.466237 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 16:43:55.466613 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.466595 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 16:43:55.466804 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.466791 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 16:43:55.477968 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.477949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446"] Jul 15 16:43:55.559729 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.559694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.559908 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.559734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf896586-6e95-470a-8ad6-46d4dce406de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.559908 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.559761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf896586-6e95-470a-8ad6-46d4dce406de-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.559908 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.559782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q474j\" (UniqueName: \"kubernetes.io/projected/cf896586-6e95-470a-8ad6-46d4dce406de-kube-api-access-q474j\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.559908 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.559852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.559908 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.559899 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf896586-6e95-470a-8ad6-46d4dce406de-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.560101 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.559959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661069 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661069 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf896586-6e95-470a-8ad6-46d4dce406de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661615 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf896586-6e95-470a-8ad6-46d4dce406de-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661615 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q474j\" (UniqueName: \"kubernetes.io/projected/cf896586-6e95-470a-8ad6-46d4dce406de-kube-api-access-q474j\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661615 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661615 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf896586-6e95-470a-8ad6-46d4dce406de-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661615 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.661997 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.661974 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf896586-6e95-470a-8ad6-46d4dce406de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.663797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.663772 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.663797 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.663785 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.663921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.663812 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf896586-6e95-470a-8ad6-46d4dce406de-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.663956 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.663939 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf896586-6e95-470a-8ad6-46d4dce406de-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.680452 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.680420 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q474j\" (UniqueName: \"kubernetes.io/projected/cf896586-6e95-470a-8ad6-46d4dce406de-kube-api-access-q474j\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.680962 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.680939 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf896586-6e95-470a-8ad6-46d4dce406de-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6z446\" (UID: \"cf896586-6e95-470a-8ad6-46d4dce406de\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.773243 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.773203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:43:55.936262 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:55.936209 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446"] Jul 15 16:43:55.939775 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:43:55.939734 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf896586_6e95_470a_8ad6_46d4dce406de.slice/crio-0df86867b02dca350f32b5c12a8d32b0df4a7167ddf774713cf0621de0697d2a WatchSource:0}: Error finding container 0df86867b02dca350f32b5c12a8d32b0df4a7167ddf774713cf0621de0697d2a: Status 404 returned error can't find the container with id 0df86867b02dca350f32b5c12a8d32b0df4a7167ddf774713cf0621de0697d2a Jul 15 16:43:56.602941 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:43:56.602907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" event={"ID":"cf896586-6e95-470a-8ad6-46d4dce406de","Type":"ContainerStarted","Data":"0df86867b02dca350f32b5c12a8d32b0df4a7167ddf774713cf0621de0697d2a"} Jul 15 16:44:02.631760 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:02.631721 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" event={"ID":"1fecd449-c71d-4fec-95b6-6cf702d54617","Type":"ContainerStarted","Data":"f840d6b81f8344aa6371173ac7e7608cc75141bd0d9902ea66e9fbf987a1dc0b"} Jul 15 16:44:02.632214 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:02.631922 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:44:02.660830 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:02.660781 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" podStartSLOduration=1.677314572 podStartE2EDuration="9.660765279s" totalImagesPullingTime="7.983450707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:02.659088102 +0000 UTC m=+418.343337331" watchObservedRunningTime="2026-07-15 16:44:02.660765279 +0000 UTC m=+418.345014506" Jul 15 16:44:03.443523 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:03.443483 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:44:03.443648 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:03.443569 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:44:03.638001 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:03.637963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" event={"ID":"cf896586-6e95-470a-8ad6-46d4dce406de","Type":"ContainerStarted","Data":"2a8b03afea94b245fdad02767713fc9899d577dcc20c1ea63c23d6c819a99513"} Jul 15 16:44:03.638502 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:03.638265 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:44:03.661709 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:03.661650 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" podStartSLOduration=1.1612332300000001 podStartE2EDuration="8.661629139s" totalImagesPullingTime="7.500395909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:03.660387295 +0000 UTC m=+419.344636535" watchObservedRunningTime="2026-07-15 16:44:03.661629139 +0000 UTC m=+419.345878365" Jul 15 16:44:04.644943 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:04.644915 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6z446" Jul 15 16:44:13.641010 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:44:13.640980 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cf9875599-7dfvg" Jul 15 16:45:46.194688 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.194649 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v"] Jul 15 16:45:46.197961 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.197941 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.200625 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.200597 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 16:45:46.200625 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.200623 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 16:45:46.200832 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.200597 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4mv6t\"" Jul 15 16:45:46.220492 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.220462 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v"] Jul 15 16:45:46.254117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.254081 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6qc\" (UniqueName: \"kubernetes.io/projected/033a4f29-0b69-4e77-ba09-c319b5b4c781-kube-api-access-5w6qc\") pod \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.254117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.254113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/033a4f29-0b69-4e77-ba09-c319b5b4c781-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.354712 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.354677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6qc\" (UniqueName: \"kubernetes.io/projected/033a4f29-0b69-4e77-ba09-c319b5b4c781-kube-api-access-5w6qc\") pod \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.354712 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.354714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/033a4f29-0b69-4e77-ba09-c319b5b4c781-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.355118 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.355102 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/033a4f29-0b69-4e77-ba09-c319b5b4c781-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.366693 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.366662 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6qc\" (UniqueName: \"kubernetes.io/projected/033a4f29-0b69-4e77-ba09-c319b5b4c781-kube-api-access-5w6qc\") pod \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.507829 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.507795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:46.511862 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.511841 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v"] Jul 15 16:45:46.521330 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.521291 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v"] Jul 15 16:45:46.543536 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.543508 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2"] Jul 15 16:45:46.546898 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.546877 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:46.562807 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.562781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2"] Jul 15 16:45:46.657055 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.657003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg9bg\" (UniqueName: \"kubernetes.io/projected/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-kube-api-access-sg9bg\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw5p2\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:46.657222 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.657151 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw5p2\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:46.758504 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.758400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw5p2\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:46.758504 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.758477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg9bg\" (UniqueName: \"kubernetes.io/projected/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-kube-api-access-sg9bg\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw5p2\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:46.758876 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.758850 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw5p2\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:46.767581 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.767561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg9bg\" (UniqueName: \"kubernetes.io/projected/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-kube-api-access-sg9bg\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw5p2\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:46.857283 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:46.857236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:47.004331 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:47.004293 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2"] Jul 15 16:45:47.007294 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:45:47.007266 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5c2ad3_cbc2_44ef_84e8_e82484d73f68.slice/crio-6a76c29695442baf4faaec89a776a6ab6e40881d5496aa7833c4f6276033e3ab WatchSource:0}: Error finding container 6a76c29695442baf4faaec89a776a6ab6e40881d5496aa7833c4f6276033e3ab: Status 404 returned error can't find the container with id 6a76c29695442baf4faaec89a776a6ab6e40881d5496aa7833c4f6276033e3ab Jul 15 16:45:47.100147 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:47.100115 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" event={"ID":"db5c2ad3-cbc2-44ef-84e8-e82484d73f68","Type":"ContainerStarted","Data":"6a76c29695442baf4faaec89a776a6ab6e40881d5496aa7833c4f6276033e3ab"} Jul 15 16:45:49.062998 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:45:49.062864 2565 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-wc52v_kuadrant-system_033a4f29-0b69-4e77-ba09-c319b5b4c781_0(1a7c32fc66517cd7fbd2c4e5047f69905c6de655a6f7d411f0eecd0e48d200b0): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-wc52v to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 15 16:45:49.062998 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:45:49.062944 2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-wc52v_kuadrant-system_033a4f29-0b69-4e77-ba09-c319b5b4c781_0(1a7c32fc66517cd7fbd2c4e5047f69905c6de655a6f7d411f0eecd0e48d200b0): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-wc52v to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:49.109922 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.109893 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:49.117827 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.117800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:49.120102 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:45:49.120077 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" is forbidden: User \"system:node:ip-10-0-142-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-145.ec2.internal' and this object" podUID="033a4f29-0b69-4e77-ba09-c319b5b4c781" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:49.181696 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.181659 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/033a4f29-0b69-4e77-ba09-c319b5b4c781-extensions-socket-volume\") pod \"033a4f29-0b69-4e77-ba09-c319b5b4c781\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " Jul 15 16:45:49.181885 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.181746 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w6qc\" (UniqueName: \"kubernetes.io/projected/033a4f29-0b69-4e77-ba09-c319b5b4c781-kube-api-access-5w6qc\") pod \"033a4f29-0b69-4e77-ba09-c319b5b4c781\" (UID: \"033a4f29-0b69-4e77-ba09-c319b5b4c781\") " Jul 15 16:45:49.182043 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.181994 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033a4f29-0b69-4e77-ba09-c319b5b4c781-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "033a4f29-0b69-4e77-ba09-c319b5b4c781" (UID: "033a4f29-0b69-4e77-ba09-c319b5b4c781"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:45:49.184204 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.184175 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/033a4f29-0b69-4e77-ba09-c319b5b4c781-kube-api-access-5w6qc" (OuterVolumeSpecName: "kube-api-access-5w6qc") pod "033a4f29-0b69-4e77-ba09-c319b5b4c781" (UID: "033a4f29-0b69-4e77-ba09-c319b5b4c781"). InnerVolumeSpecName "kube-api-access-5w6qc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:45:49.283029 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.282978 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/033a4f29-0b69-4e77-ba09-c319b5b4c781-extensions-socket-volume\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:45:49.283029 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:49.283008 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w6qc\" (UniqueName: \"kubernetes.io/projected/033a4f29-0b69-4e77-ba09-c319b5b4c781-kube-api-access-5w6qc\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:45:50.114148 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:50.114116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:50.117077 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:45:50.117047 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" is forbidden: User \"system:node:ip-10-0-142-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-145.ec2.internal' and this object" podUID="033a4f29-0b69-4e77-ba09-c319b5b4c781" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:50.123385 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:45:50.123354 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-wc52v\" is forbidden: User \"system:node:ip-10-0-142-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-145.ec2.internal' and this object" podUID="033a4f29-0b69-4e77-ba09-c319b5b4c781" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wc52v" Jul 15 16:45:50.900246 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:50.900212 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="033a4f29-0b69-4e77-ba09-c319b5b4c781" path="/var/lib/kubelet/pods/033a4f29-0b69-4e77-ba09-c319b5b4c781/volumes" Jul 15 16:45:53.131338 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:53.131302 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" event={"ID":"db5c2ad3-cbc2-44ef-84e8-e82484d73f68","Type":"ContainerStarted","Data":"45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb"} Jul 15 16:45:53.131752 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:53.131425 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:45:53.156806 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:45:53.156754 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" podStartSLOduration=2.102240305 podStartE2EDuration="7.156736005s" totalImagesPullingTime="5.0544957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:45:53.155466422 +0000 UTC m=+528.839715651" watchObservedRunningTime="2026-07-15 16:45:53.156736005 +0000 UTC m=+528.840985309" Jul 15 16:46:04.138942 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:04.138865 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:46:13.934431 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:13.934389 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b9c4c45-cshp6"] Jul 15 16:46:16.880513 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:16.880474 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2"] Jul 15 16:46:16.881106 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:16.880707 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" podUID="db5c2ad3-cbc2-44ef-84e8-e82484d73f68" containerName="manager" containerID="cri-o://45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb" gracePeriod=10 Jul 15 16:46:17.139506 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.139429 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:46:17.236484 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.236447 2565 generic.go:356] "Generic (PLEG): container finished" podID="db5c2ad3-cbc2-44ef-84e8-e82484d73f68" containerID="45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb" exitCode=0 Jul 15 16:46:17.236484 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.236490 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" Jul 15 16:46:17.236707 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.236491 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" event={"ID":"db5c2ad3-cbc2-44ef-84e8-e82484d73f68","Type":"ContainerDied","Data":"45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb"} Jul 15 16:46:17.236707 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.236617 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2" event={"ID":"db5c2ad3-cbc2-44ef-84e8-e82484d73f68","Type":"ContainerDied","Data":"6a76c29695442baf4faaec89a776a6ab6e40881d5496aa7833c4f6276033e3ab"} Jul 15 16:46:17.236707 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.236645 2565 scope.go:117] "RemoveContainer" containerID="45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb" Jul 15 16:46:17.242458 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.242428 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg9bg\" (UniqueName: \"kubernetes.io/projected/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-kube-api-access-sg9bg\") pod \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " Jul 15 16:46:17.242615 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.242472 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-extensions-socket-volume\") pod \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\" (UID: \"db5c2ad3-cbc2-44ef-84e8-e82484d73f68\") " Jul 15 16:46:17.242937 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.242914 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db5c2ad3-cbc2-44ef-84e8-e82484d73f68" (UID: "db5c2ad3-cbc2-44ef-84e8-e82484d73f68"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:46:17.244970 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.244938 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-kube-api-access-sg9bg" (OuterVolumeSpecName: "kube-api-access-sg9bg") pod "db5c2ad3-cbc2-44ef-84e8-e82484d73f68" (UID: "db5c2ad3-cbc2-44ef-84e8-e82484d73f68"). InnerVolumeSpecName "kube-api-access-sg9bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:46:17.246839 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.246816 2565 scope.go:117] "RemoveContainer" containerID="45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb" Jul 15 16:46:17.247202 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:46:17.247178 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb\": container with ID starting with 45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb not found: ID does not exist" containerID="45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb" Jul 15 16:46:17.247361 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.247329 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb"} err="failed to get container status \"45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb\": rpc error: code = NotFound desc = could not find container \"45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb\": container with ID starting with 45ec165d7a3e93bf192cf7b733d3024bcadd25dcf31885ed533d80d3c531f5bb not found: ID does not exist" Jul 15 16:46:17.343847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.343809 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-extensions-socket-volume\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:17.343847 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.343850 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg9bg\" (UniqueName: \"kubernetes.io/projected/db5c2ad3-cbc2-44ef-84e8-e82484d73f68-kube-api-access-sg9bg\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:17.565419 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.565387 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2"] Jul 15 16:46:17.567808 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:17.567772 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw5p2"] Jul 15 16:46:18.900284 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:18.900253 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db5c2ad3-cbc2-44ef-84e8-e82484d73f68" path="/var/lib/kubelet/pods/db5c2ad3-cbc2-44ef-84e8-e82484d73f68/volumes" Jul 15 16:46:20.625943 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.625913 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk"] Jul 15 16:46:20.626352 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.626293 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5c2ad3-cbc2-44ef-84e8-e82484d73f68" containerName="manager" Jul 15 16:46:20.626352 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.626308 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5c2ad3-cbc2-44ef-84e8-e82484d73f68" containerName="manager" Jul 15 16:46:20.626439 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.626375 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="db5c2ad3-cbc2-44ef-84e8-e82484d73f68" containerName="manager" Jul 15 16:46:20.630736 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.630716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.633098 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.633078 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fkm5q\"" Jul 15 16:46:20.641121 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.641103 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk"] Jul 15 16:46:20.676256 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676443 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676443 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zn9t\" (UniqueName: \"kubernetes.io/projected/3a8c1955-28be-438c-ab0f-488ddeb183bc-kube-api-access-9zn9t\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676443 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8c1955-28be-438c-ab0f-488ddeb183bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.676656 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.676579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.777562 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.777562 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.777826 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8c1955-28be-438c-ab0f-488ddeb183bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.777826 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.777826 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.777826 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.777826 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.778126 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zn9t\" (UniqueName: \"kubernetes.io/projected/3a8c1955-28be-438c-ab0f-488ddeb183bc-kube-api-access-9zn9t\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.778126 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.777957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.778126 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.778051 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.778271 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.778127 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.778372 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.778345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.778554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.778531 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.778554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.778545 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8c1955-28be-438c-ab0f-488ddeb183bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.780094 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.780074 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.780224 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.780209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.785877 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.785853 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8c1955-28be-438c-ab0f-488ddeb183bc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.786218 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.786201 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zn9t\" (UniqueName: \"kubernetes.io/projected/3a8c1955-28be-438c-ab0f-488ddeb183bc-kube-api-access-9zn9t\") pod \"maas-default-gateway-openshift-default-56654dcf7-gkmxk\" (UID: \"3a8c1955-28be-438c-ab0f-488ddeb183bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:20.941445 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:20.941359 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:21.080634 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:21.080601 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk"] Jul 15 16:46:21.083943 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:46:21.083920 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8c1955_28be_438c_ab0f_488ddeb183bc.slice/crio-e532bd5db8a2af11442f106ff219cd566c68925e65598eb3f68236ab61c22fd8 WatchSource:0}: Error finding container e532bd5db8a2af11442f106ff219cd566c68925e65598eb3f68236ab61c22fd8: Status 404 returned error can't find the container with id e532bd5db8a2af11442f106ff219cd566c68925e65598eb3f68236ab61c22fd8 Jul 15 16:46:21.255155 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:21.255123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" event={"ID":"3a8c1955-28be-438c-ab0f-488ddeb183bc","Type":"ContainerStarted","Data":"e532bd5db8a2af11442f106ff219cd566c68925e65598eb3f68236ab61c22fd8"} Jul 15 16:46:23.907210 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:23.907179 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:46:23.907460 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:23.907248 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:46:23.907460 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:23.907277 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:46:24.271207 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:24.271166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" event={"ID":"3a8c1955-28be-438c-ab0f-488ddeb183bc","Type":"ContainerStarted","Data":"d57cb6c68c7e8630fd699be86e3db3ae6cd4199cf307f5e08413bb963dfcd87d"} Jul 15 16:46:24.295559 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:24.295508 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" podStartSLOduration=1.474816041 podStartE2EDuration="4.295490873s" totalImagesPullingTime="2.820674832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:46:24.293435089 +0000 UTC m=+559.977684318" watchObservedRunningTime="2026-07-15 16:46:24.295490873 +0000 UTC m=+559.979740098" Jul 15 16:46:24.941541 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:24.941515 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:24.947615 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:24.947592 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:25.276166 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:25.276132 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:25.277058 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:25.277039 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:46:33.266576 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.266541 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7wvk"] Jul 15 16:46:33.269853 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.269822 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.272421 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.272391 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pszz2\"" Jul 15 16:46:33.272421 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.272394 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 16:46:33.273361 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.273344 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 16:46:33.273470 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.273371 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 16:46:33.278664 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.278643 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7wvk"] Jul 15 16:46:33.367893 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.367859 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7wvk"] Jul 15 16:46:33.387672 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.387638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37f4fae-8534-4497-aa16-defff15aec21-config-file\") pod \"limitador-limitador-64c94fd64f-n7wvk\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.387672 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.387675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf5gn\" (UniqueName: \"kubernetes.io/projected/f37f4fae-8534-4497-aa16-defff15aec21-kube-api-access-wf5gn\") pod \"limitador-limitador-64c94fd64f-n7wvk\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.488896 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.488860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37f4fae-8534-4497-aa16-defff15aec21-config-file\") pod \"limitador-limitador-64c94fd64f-n7wvk\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.488896 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.488897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf5gn\" (UniqueName: \"kubernetes.io/projected/f37f4fae-8534-4497-aa16-defff15aec21-kube-api-access-wf5gn\") pod \"limitador-limitador-64c94fd64f-n7wvk\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.489538 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.489519 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37f4fae-8534-4497-aa16-defff15aec21-config-file\") pod \"limitador-limitador-64c94fd64f-n7wvk\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.498229 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.498195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf5gn\" (UniqueName: \"kubernetes.io/projected/f37f4fae-8534-4497-aa16-defff15aec21-kube-api-access-wf5gn\") pod \"limitador-limitador-64c94fd64f-n7wvk\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.581280 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.581186 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:33.725145 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:33.725108 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7wvk"] Jul 15 16:46:33.728346 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:46:33.728314 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37f4fae_8534_4497_aa16_defff15aec21.slice/crio-04900f248768e1c44b3f753aec58751fd31717e781d483eae718022d890da492 WatchSource:0}: Error finding container 04900f248768e1c44b3f753aec58751fd31717e781d483eae718022d890da492: Status 404 returned error can't find the container with id 04900f248768e1c44b3f753aec58751fd31717e781d483eae718022d890da492 Jul 15 16:46:34.315856 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:34.315816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" event={"ID":"f37f4fae-8534-4497-aa16-defff15aec21","Type":"ContainerStarted","Data":"04900f248768e1c44b3f753aec58751fd31717e781d483eae718022d890da492"} Jul 15 16:46:37.332528 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:37.332489 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" event={"ID":"f37f4fae-8534-4497-aa16-defff15aec21","Type":"ContainerStarted","Data":"cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347"} Jul 15 16:46:37.332993 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:37.332575 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:37.351463 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:37.351413 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" podStartSLOduration=1.64196329 podStartE2EDuration="4.351394959s" totalImagesPullingTime="2.709431669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:46:37.350940042 +0000 UTC m=+573.035189269" watchObservedRunningTime="2026-07-15 16:46:37.351394959 +0000 UTC m=+573.035644185" Jul 15 16:46:38.955030 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:38.954971 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68b9c4c45-cshp6" podUID="ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" containerName="console" containerID="cri-o://12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82" gracePeriod=15 Jul 15 16:46:39.214807 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.214745 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:46:39.343191 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.343156 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" containerID="12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82" exitCode=0 Jul 15 16:46:39.343378 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.343211 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9c4c45-cshp6" Jul 15 16:46:39.343378 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.343220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9c4c45-cshp6" event={"ID":"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b","Type":"ContainerDied","Data":"12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82"} Jul 15 16:46:39.343378 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.343267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9c4c45-cshp6" event={"ID":"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b","Type":"ContainerDied","Data":"69db510c1065ef6242d45a6c645ce78933622c005f081a91df6d31b6d619442d"} Jul 15 16:46:39.343378 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.343291 2565 scope.go:117] "RemoveContainer" containerID="12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82" Jul 15 16:46:39.346648 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.346622 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-oauth-serving-cert\") pod \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " Jul 15 16:46:39.346780 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.346661 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-service-ca\") pod \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " Jul 15 16:46:39.346780 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.346681 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5lm7\" (UniqueName: \"kubernetes.io/projected/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-kube-api-access-f5lm7\") pod \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " Jul 15 16:46:39.346780 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.346738 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-trusted-ca-bundle\") pod \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " Jul 15 16:46:39.346965 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.346785 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-config\") pod \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " Jul 15 16:46:39.346965 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.346852 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-serving-cert\") pod \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " Jul 15 16:46:39.346965 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.346888 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-oauth-config\") pod \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\" (UID: \"ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b\") " Jul 15 16:46:39.347291 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.347040 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" (UID: "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:46:39.347291 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.347137 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" (UID: "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:46:39.347291 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.347178 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" (UID: "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:46:39.347439 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.347380 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-oauth-serving-cert\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:39.347439 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.347399 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-service-ca\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:39.347439 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.347412 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-trusted-ca-bundle\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:39.347719 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.347682 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-config" (OuterVolumeSpecName: "console-config") pod "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" (UID: "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:46:39.349261 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.349239 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" (UID: "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:46:39.349405 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.349389 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" (UID: "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:46:39.349467 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.349388 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-kube-api-access-f5lm7" (OuterVolumeSpecName: "kube-api-access-f5lm7") pod "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" (UID: "ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b"). InnerVolumeSpecName "kube-api-access-f5lm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:46:39.352503 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.352483 2565 scope.go:117] "RemoveContainer" containerID="12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82" Jul 15 16:46:39.352842 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:46:39.352823 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82\": container with ID starting with 12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82 not found: ID does not exist" containerID="12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82" Jul 15 16:46:39.352905 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.352851 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82"} err="failed to get container status \"12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82\": rpc error: code = NotFound desc = could not find container \"12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82\": container with ID starting with 12a781ac8e15e7668c8cc70500d8d9c111490f6df124c959972e920a0d076e82 not found: ID does not exist" Jul 15 16:46:39.448716 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.448673 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-config\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:39.448716 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.448706 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-serving-cert\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:39.448716 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.448715 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-console-oauth-config\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:39.448716 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.448725 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5lm7\" (UniqueName: \"kubernetes.io/projected/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b-kube-api-access-f5lm7\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:39.667133 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.667099 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b9c4c45-cshp6"] Jul 15 16:46:39.672184 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:39.672154 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68b9c4c45-cshp6"] Jul 15 16:46:40.898779 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:40.898744 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" path="/var/lib/kubelet/pods/ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b/volumes" Jul 15 16:46:48.037938 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.037898 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7wvk"] Jul 15 16:46:48.038545 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.038142 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" podUID="f37f4fae-8534-4497-aa16-defff15aec21" containerName="limitador" containerID="cri-o://cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347" gracePeriod=30 Jul 15 16:46:48.038958 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.038879 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:48.586731 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.586704 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:48.742707 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.742675 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37f4fae-8534-4497-aa16-defff15aec21-config-file\") pod \"f37f4fae-8534-4497-aa16-defff15aec21\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " Jul 15 16:46:48.742871 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.742716 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf5gn\" (UniqueName: \"kubernetes.io/projected/f37f4fae-8534-4497-aa16-defff15aec21-kube-api-access-wf5gn\") pod \"f37f4fae-8534-4497-aa16-defff15aec21\" (UID: \"f37f4fae-8534-4497-aa16-defff15aec21\") " Jul 15 16:46:48.743144 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.743124 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37f4fae-8534-4497-aa16-defff15aec21-config-file" (OuterVolumeSpecName: "config-file") pod "f37f4fae-8534-4497-aa16-defff15aec21" (UID: "f37f4fae-8534-4497-aa16-defff15aec21"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:46:48.744895 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.744867 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37f4fae-8534-4497-aa16-defff15aec21-kube-api-access-wf5gn" (OuterVolumeSpecName: "kube-api-access-wf5gn") pod "f37f4fae-8534-4497-aa16-defff15aec21" (UID: "f37f4fae-8534-4497-aa16-defff15aec21"). InnerVolumeSpecName "kube-api-access-wf5gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:46:48.844048 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.843987 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37f4fae-8534-4497-aa16-defff15aec21-config-file\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:48.844269 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:48.844076 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf5gn\" (UniqueName: \"kubernetes.io/projected/f37f4fae-8534-4497-aa16-defff15aec21-kube-api-access-wf5gn\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:46:49.389417 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.389388 2565 generic.go:356] "Generic (PLEG): container finished" podID="f37f4fae-8534-4497-aa16-defff15aec21" containerID="cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347" exitCode=0 Jul 15 16:46:49.389869 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.389441 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" Jul 15 16:46:49.389869 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.389477 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" event={"ID":"f37f4fae-8534-4497-aa16-defff15aec21","Type":"ContainerDied","Data":"cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347"} Jul 15 16:46:49.389869 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.389545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7wvk" event={"ID":"f37f4fae-8534-4497-aa16-defff15aec21","Type":"ContainerDied","Data":"04900f248768e1c44b3f753aec58751fd31717e781d483eae718022d890da492"} Jul 15 16:46:49.389869 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.389583 2565 scope.go:117] "RemoveContainer" containerID="cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347" Jul 15 16:46:49.398395 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.398379 2565 scope.go:117] "RemoveContainer" containerID="cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347" Jul 15 16:46:49.398677 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:46:49.398656 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347\": container with ID starting with cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347 not found: ID does not exist" containerID="cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347" Jul 15 16:46:49.398725 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.398686 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347"} err="failed to get container status \"cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347\": rpc error: code = NotFound desc = could not find container \"cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347\": container with ID starting with cf3d71cc3cab10337a5b871ff070f8920f676cc7da83ea29f0fb56e08f730347 not found: ID does not exist" Jul 15 16:46:49.407246 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.407216 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7wvk"] Jul 15 16:46:49.417791 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:49.417755 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7wvk"] Jul 15 16:46:50.899600 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:50.899569 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37f4fae-8534-4497-aa16-defff15aec21" path="/var/lib/kubelet/pods/f37f4fae-8534-4497-aa16-defff15aec21/volumes" Jul 15 16:46:52.209474 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.209439 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd"] Jul 15 16:46:52.209942 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.209923 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" containerName="console" Jul 15 16:46:52.209986 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.209947 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" containerName="console" Jul 15 16:46:52.209986 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.209983 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37f4fae-8534-4497-aa16-defff15aec21" containerName="limitador" Jul 15 16:46:52.210092 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.209992 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37f4fae-8534-4497-aa16-defff15aec21" containerName="limitador" Jul 15 16:46:52.210126 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.210090 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec97b2b0-e0ae-400f-b66c-4a64dae9ff0b" containerName="console" Jul 15 16:46:52.210126 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.210106 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37f4fae-8534-4497-aa16-defff15aec21" containerName="limitador" Jul 15 16:46:52.215130 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.215107 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.217970 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.217946 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 16:46:52.218177 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.217949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tdgm6\"" Jul 15 16:46:52.218623 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.218599 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 16:46:52.218718 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.218648 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 16:46:52.221580 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.221545 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd"] Jul 15 16:46:52.376345 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.376300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ed7026c-605d-4ae0-97ce-e0feb02478c5-data\") pod \"postgres-69fb4594cf-jtkgd\" (UID: \"7ed7026c-605d-4ae0-97ce-e0feb02478c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.376514 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.376353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr76r\" (UniqueName: \"kubernetes.io/projected/7ed7026c-605d-4ae0-97ce-e0feb02478c5-kube-api-access-dr76r\") pod \"postgres-69fb4594cf-jtkgd\" (UID: \"7ed7026c-605d-4ae0-97ce-e0feb02478c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.477617 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.477587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr76r\" (UniqueName: \"kubernetes.io/projected/7ed7026c-605d-4ae0-97ce-e0feb02478c5-kube-api-access-dr76r\") pod \"postgres-69fb4594cf-jtkgd\" (UID: \"7ed7026c-605d-4ae0-97ce-e0feb02478c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.477780 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.477686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ed7026c-605d-4ae0-97ce-e0feb02478c5-data\") pod \"postgres-69fb4594cf-jtkgd\" (UID: \"7ed7026c-605d-4ae0-97ce-e0feb02478c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.478002 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.477985 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ed7026c-605d-4ae0-97ce-e0feb02478c5-data\") pod \"postgres-69fb4594cf-jtkgd\" (UID: \"7ed7026c-605d-4ae0-97ce-e0feb02478c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.490881 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.490852 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr76r\" (UniqueName: \"kubernetes.io/projected/7ed7026c-605d-4ae0-97ce-e0feb02478c5-kube-api-access-dr76r\") pod \"postgres-69fb4594cf-jtkgd\" (UID: \"7ed7026c-605d-4ae0-97ce-e0feb02478c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.527339 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.527299 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:52.668845 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:52.668688 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd"] Jul 15 16:46:52.671205 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:46:52.671174 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed7026c_605d_4ae0_97ce_e0feb02478c5.slice/crio-689443d5bdaa16a40803d4a2fc6743649d7e0ee029f21cdec43959827aad4122 WatchSource:0}: Error finding container 689443d5bdaa16a40803d4a2fc6743649d7e0ee029f21cdec43959827aad4122: Status 404 returned error can't find the container with id 689443d5bdaa16a40803d4a2fc6743649d7e0ee029f21cdec43959827aad4122 Jul 15 16:46:53.413255 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:53.413212 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" event={"ID":"7ed7026c-605d-4ae0-97ce-e0feb02478c5","Type":"ContainerStarted","Data":"689443d5bdaa16a40803d4a2fc6743649d7e0ee029f21cdec43959827aad4122"} Jul 15 16:46:58.440329 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:58.440290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" event={"ID":"7ed7026c-605d-4ae0-97ce-e0feb02478c5","Type":"ContainerStarted","Data":"4b8562b8355b8b63d1350805a3b9b425be2bf6d74d7f4fad09b29e19108a4c8c"} Jul 15 16:46:58.440720 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:58.440396 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:46:58.469185 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:46:58.469126 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" podStartSLOduration=1.736645343 podStartE2EDuration="6.469110128s" totalImagesPullingTime="4.732464785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:46:58.468386122 +0000 UTC m=+594.152635350" watchObservedRunningTime="2026-07-15 16:46:58.469110128 +0000 UTC m=+594.153359353" Jul 15 16:47:04.475206 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:04.475166 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jtkgd" Jul 15 16:47:04.790118 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:04.789999 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:47:04.790598 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:04.790574 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:47:04.798192 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:04.798165 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:47:04.798753 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:04.798730 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:47:12.809070 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.809031 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d4f4bc5c5-8cbk4"] Jul 15 16:47:12.814145 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.814116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:12.816626 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.816598 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 16:47:12.816784 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.816650 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9p2m\"" Jul 15 16:47:12.816784 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.816651 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 16:47:12.823369 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.823344 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4f4bc5c5-8cbk4"] Jul 15 16:47:12.867970 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.867937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert\") pod \"maas-controller-5d4f4bc5c5-8cbk4\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:12.867970 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.867974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t594z\" (UniqueName: \"kubernetes.io/projected/515e9e73-f4b6-424a-9a13-41351a9cb9ea-kube-api-access-t594z\") pod \"maas-controller-5d4f4bc5c5-8cbk4\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:12.968982 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.968945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert\") pod \"maas-controller-5d4f4bc5c5-8cbk4\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:12.969193 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.968993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t594z\" (UniqueName: \"kubernetes.io/projected/515e9e73-f4b6-424a-9a13-41351a9cb9ea-kube-api-access-t594z\") pod \"maas-controller-5d4f4bc5c5-8cbk4\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:12.969193 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:47:12.969116 2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 15 16:47:12.969287 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:47:12.969195 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert podName:515e9e73-f4b6-424a-9a13-41351a9cb9ea nodeName:}" failed. No retries permitted until 2026-07-15 16:47:13.469176699 +0000 UTC m=+609.153425909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert") pod "maas-controller-5d4f4bc5c5-8cbk4" (UID: "515e9e73-f4b6-424a-9a13-41351a9cb9ea") : secret "maas-controller-webhook-cert" not found Jul 15 16:47:12.980566 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:12.980538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t594z\" (UniqueName: \"kubernetes.io/projected/515e9e73-f4b6-424a-9a13-41351a9cb9ea-kube-api-access-t594z\") pod \"maas-controller-5d4f4bc5c5-8cbk4\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:13.473936 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:13.473896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert\") pod \"maas-controller-5d4f4bc5c5-8cbk4\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:13.476346 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:13.476315 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert\") pod \"maas-controller-5d4f4bc5c5-8cbk4\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:13.726836 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:13.726748 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:13.861088 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:13.861061 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4f4bc5c5-8cbk4"] Jul 15 16:47:13.863774 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:47:13.863738 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515e9e73_f4b6_424a_9a13_41351a9cb9ea.slice/crio-f5deab42958e42809b3675c31c1a3c4efe418849ccc2fec8bcfa74962b0c7c15 WatchSource:0}: Error finding container f5deab42958e42809b3675c31c1a3c4efe418849ccc2fec8bcfa74962b0c7c15: Status 404 returned error can't find the container with id f5deab42958e42809b3675c31c1a3c4efe418849ccc2fec8bcfa74962b0c7c15 Jul 15 16:47:14.514624 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:14.514582 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" event={"ID":"515e9e73-f4b6-424a-9a13-41351a9cb9ea","Type":"ContainerStarted","Data":"f5deab42958e42809b3675c31c1a3c4efe418849ccc2fec8bcfa74962b0c7c15"} Jul 15 16:47:16.526874 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:16.526834 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" event={"ID":"515e9e73-f4b6-424a-9a13-41351a9cb9ea","Type":"ContainerStarted","Data":"bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7"} Jul 15 16:47:16.527278 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:16.526929 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:16.559041 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:16.558966 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" podStartSLOduration=2.04974911 podStartE2EDuration="4.558949121s" totalImagesPullingTime="2.509200011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:47:16.556511911 +0000 UTC m=+612.240761137" watchObservedRunningTime="2026-07-15 16:47:16.558949121 +0000 UTC m=+612.243198348" Jul 15 16:47:27.535011 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:27.534940 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:28.134246 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.134209 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4f4bc5c5-8cbk4"] Jul 15 16:47:28.134469 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.134405 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" podUID="515e9e73-f4b6-424a-9a13-41351a9cb9ea" containerName="manager" containerID="cri-o://bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7" gracePeriod=30 Jul 15 16:47:28.383595 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.383569 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:28.516201 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.516165 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t594z\" (UniqueName: \"kubernetes.io/projected/515e9e73-f4b6-424a-9a13-41351a9cb9ea-kube-api-access-t594z\") pod \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " Jul 15 16:47:28.516409 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.516214 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert\") pod \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\" (UID: \"515e9e73-f4b6-424a-9a13-41351a9cb9ea\") " Jul 15 16:47:28.518473 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.518434 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "515e9e73-f4b6-424a-9a13-41351a9cb9ea" (UID: "515e9e73-f4b6-424a-9a13-41351a9cb9ea"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 16:47:28.518591 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.518500 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515e9e73-f4b6-424a-9a13-41351a9cb9ea-kube-api-access-t594z" (OuterVolumeSpecName: "kube-api-access-t594z") pod "515e9e73-f4b6-424a-9a13-41351a9cb9ea" (UID: "515e9e73-f4b6-424a-9a13-41351a9cb9ea"). InnerVolumeSpecName "kube-api-access-t594z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:47:28.582349 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.582310 2565 generic.go:356] "Generic (PLEG): container finished" podID="515e9e73-f4b6-424a-9a13-41351a9cb9ea" containerID="bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7" exitCode=0 Jul 15 16:47:28.582737 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.582358 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" Jul 15 16:47:28.582737 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.582374 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" event={"ID":"515e9e73-f4b6-424a-9a13-41351a9cb9ea","Type":"ContainerDied","Data":"bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7"} Jul 15 16:47:28.582737 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.582426 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4f4bc5c5-8cbk4" event={"ID":"515e9e73-f4b6-424a-9a13-41351a9cb9ea","Type":"ContainerDied","Data":"f5deab42958e42809b3675c31c1a3c4efe418849ccc2fec8bcfa74962b0c7c15"} Jul 15 16:47:28.582737 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.582459 2565 scope.go:117] "RemoveContainer" containerID="bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7" Jul 15 16:47:28.591402 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.591384 2565 scope.go:117] "RemoveContainer" containerID="bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7" Jul 15 16:47:28.591676 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:47:28.591656 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7\": container with ID starting with bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7 not found: ID does not exist" containerID="bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7" Jul 15 16:47:28.591760 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.591683 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7"} err="failed to get container status \"bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7\": rpc error: code = NotFound desc = could not find container \"bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7\": container with ID starting with bb61d1fd429c5d017c2ca5641443281ad3425d911b3a3980b01271946ebefaf7 not found: ID does not exist" Jul 15 16:47:28.604642 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.604609 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4f4bc5c5-8cbk4"] Jul 15 16:47:28.608126 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.608099 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d4f4bc5c5-8cbk4"] Jul 15 16:47:28.616800 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.616780 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515e9e73-f4b6-424a-9a13-41351a9cb9ea-webhook-cert\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:47:28.616885 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.616803 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t594z\" (UniqueName: \"kubernetes.io/projected/515e9e73-f4b6-424a-9a13-41351a9cb9ea-kube-api-access-t594z\") on node \"ip-10-0-142-145.ec2.internal\" DevicePath \"\"" Jul 15 16:47:28.898573 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:28.898494 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515e9e73-f4b6-424a-9a13-41351a9cb9ea" path="/var/lib/kubelet/pods/515e9e73-f4b6-424a-9a13-41351a9cb9ea/volumes" Jul 15 16:47:51.460932 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.460897 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk"] Jul 15 16:47:51.461440 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.461373 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515e9e73-f4b6-424a-9a13-41351a9cb9ea" containerName="manager" Jul 15 16:47:51.461440 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.461390 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="515e9e73-f4b6-424a-9a13-41351a9cb9ea" containerName="manager" Jul 15 16:47:51.461526 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.461481 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="515e9e73-f4b6-424a-9a13-41351a9cb9ea" containerName="manager" Jul 15 16:47:51.468222 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.468202 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.472347 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.472324 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 16:47:51.476612 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.476584 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk"] Jul 15 16:47:51.511456 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.511420 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2045cd5-f276-40db-a3c1-e11024f88fc2-maas-api-tls\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.511657 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.511481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgvf6\" (UniqueName: \"kubernetes.io/projected/c2045cd5-f276-40db-a3c1-e11024f88fc2-kube-api-access-zgvf6\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.511657 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.511561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2045cd5-f276-40db-a3c1-e11024f88fc2-openshift-service-ca\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.612892 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.612850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2045cd5-f276-40db-a3c1-e11024f88fc2-maas-api-tls\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.613117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.612922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgvf6\" (UniqueName: \"kubernetes.io/projected/c2045cd5-f276-40db-a3c1-e11024f88fc2-kube-api-access-zgvf6\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.613117 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.612952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2045cd5-f276-40db-a3c1-e11024f88fc2-openshift-service-ca\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.613117 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:47:51.613004 2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 15 16:47:51.613117 ip-10-0-142-145 kubenswrapper[2565]: E0715 16:47:51.613117 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2045cd5-f276-40db-a3c1-e11024f88fc2-maas-api-tls podName:c2045cd5-f276-40db-a3c1-e11024f88fc2 nodeName:}" failed. No retries permitted until 2026-07-15 16:47:52.113092485 +0000 UTC m=+647.797341688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c2045cd5-f276-40db-a3c1-e11024f88fc2-maas-api-tls") pod "maas-api-57bb95dfb6-k69qk" (UID: "c2045cd5-f276-40db-a3c1-e11024f88fc2") : secret "maas-api-serving-cert" not found Jul 15 16:47:51.613576 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.613558 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2045cd5-f276-40db-a3c1-e11024f88fc2-openshift-service-ca\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:51.630058 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:51.630003 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgvf6\" (UniqueName: \"kubernetes.io/projected/c2045cd5-f276-40db-a3c1-e11024f88fc2-kube-api-access-zgvf6\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:52.060700 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.060665 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s47ch"] Jul 15 16:47:52.064109 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.064091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.066946 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.066927 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9n7nq\"" Jul 15 16:47:52.067225 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.067210 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 16:47:52.074830 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.074801 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s47ch"] Jul 15 16:47:52.118501 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.118462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s47ch\" (UID: \"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.118706 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.118537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2045cd5-f276-40db-a3c1-e11024f88fc2-maas-api-tls\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:52.118706 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.118584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6f4z\" (UniqueName: \"kubernetes.io/projected/c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19-kube-api-access-m6f4z\") pod \"payload-processing-f9b8d9b9b-s47ch\" (UID: \"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.121124 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.121095 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2045cd5-f276-40db-a3c1-e11024f88fc2-maas-api-tls\") pod \"maas-api-57bb95dfb6-k69qk\" (UID: \"c2045cd5-f276-40db-a3c1-e11024f88fc2\") " pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:52.219279 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.219246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s47ch\" (UID: \"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.219445 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.219304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6f4z\" (UniqueName: \"kubernetes.io/projected/c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19-kube-api-access-m6f4z\") pod \"payload-processing-f9b8d9b9b-s47ch\" (UID: \"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.219976 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.219956 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s47ch\" (UID: \"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.229856 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.229832 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6f4z\" (UniqueName: \"kubernetes.io/projected/c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19-kube-api-access-m6f4z\") pod \"payload-processing-f9b8d9b9b-s47ch\" (UID: \"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.377135 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.377039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:52.381046 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.381010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:52.537375 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.537349 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s47ch"] Jul 15 16:47:52.540307 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:47:52.540278 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc452bfa4_1d8f_4ce8_aa9c_2f83120ddf19.slice/crio-e694775026f6c1e2a76f1314d237a08b588ea156835b3efceaa005f709381767 WatchSource:0}: Error finding container e694775026f6c1e2a76f1314d237a08b588ea156835b3efceaa005f709381767: Status 404 returned error can't find the container with id e694775026f6c1e2a76f1314d237a08b588ea156835b3efceaa005f709381767 Jul 15 16:47:52.542448 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.542433 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:47:52.551481 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.551460 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk"] Jul 15 16:47:52.553232 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:47:52.553201 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2045cd5_f276_40db_a3c1_e11024f88fc2.slice/crio-0b074beaefecb678814276c88d86a0ffb9b2b60bf3373f9b79f6bad1b6bcaeef WatchSource:0}: Error finding container 0b074beaefecb678814276c88d86a0ffb9b2b60bf3373f9b79f6bad1b6bcaeef: Status 404 returned error can't find the container with id 0b074beaefecb678814276c88d86a0ffb9b2b60bf3373f9b79f6bad1b6bcaeef Jul 15 16:47:52.697307 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.697199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" event={"ID":"c2045cd5-f276-40db-a3c1-e11024f88fc2","Type":"ContainerStarted","Data":"0b074beaefecb678814276c88d86a0ffb9b2b60bf3373f9b79f6bad1b6bcaeef"} Jul 15 16:47:52.698369 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:52.698340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" event={"ID":"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19","Type":"ContainerStarted","Data":"e694775026f6c1e2a76f1314d237a08b588ea156835b3efceaa005f709381767"} Jul 15 16:47:55.717028 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:55.716978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" event={"ID":"c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19","Type":"ContainerStarted","Data":"d1e6a6a44de1ce5c149bdd54441fe1c742c84c4091d86492a20238a3d9507e8d"} Jul 15 16:47:55.717471 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:55.717060 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:47:55.718631 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:55.718601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" event={"ID":"c2045cd5-f276-40db-a3c1-e11024f88fc2","Type":"ContainerStarted","Data":"ff812032a6facd3279c718a12031c150e19f2aa04837303ee9bf4be66beada6d"} Jul 15 16:47:55.718773 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:55.718656 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:47:55.734200 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:55.734143 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" podStartSLOduration=1.368775212 podStartE2EDuration="3.734126396s" totalImagesPullingTime="2.365351184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:47:55.733042321 +0000 UTC m=+651.417291544" watchObservedRunningTime="2026-07-15 16:47:55.734126396 +0000 UTC m=+651.418375603" Jul 15 16:47:55.749214 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:55.749156 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" podStartSLOduration=2.392860268 podStartE2EDuration="4.749142093s" totalImagesPullingTime="2.356281825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:47:55.748653927 +0000 UTC m=+651.432903153" watchObservedRunningTime="2026-07-15 16:47:55.749142093 +0000 UTC m=+651.433391320" Jul 15 16:47:59.739203 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:59.739171 2565 generic.go:356] "Generic (PLEG): container finished" podID="3a8c1955-28be-438c-ab0f-488ddeb183bc" containerID="d57cb6c68c7e8630fd699be86e3db3ae6cd4199cf307f5e08413bb963dfcd87d" exitCode=0 Jul 15 16:47:59.739601 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:59.739248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" event={"ID":"3a8c1955-28be-438c-ab0f-488ddeb183bc","Type":"ContainerDied","Data":"d57cb6c68c7e8630fd699be86e3db3ae6cd4199cf307f5e08413bb963dfcd87d"} Jul 15 16:47:59.739647 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:59.739638 2565 scope.go:117] "RemoveContainer" containerID="d57cb6c68c7e8630fd699be86e3db3ae6cd4199cf307f5e08413bb963dfcd87d" Jul 15 16:47:59.740663 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:59.740629 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:47:59.740719 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:59.740702 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:47:59.740763 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:47:59.740736 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 16:48:00.752608 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:00.752570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" event={"ID":"3a8c1955-28be-438c-ab0f-488ddeb183bc","Type":"ContainerStarted","Data":"cab0916e15429f634c6cec2b0cbdd691fc37c309fd4a008bf8d239612d60ec01"} Jul 15 16:48:00.941554 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:00.941520 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:48:00.941758 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:00.941739 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gkmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 16:48:00.941809 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:00.941795 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" podUID="3a8c1955-28be-438c-ab0f-488ddeb183bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 16:48:01.728731 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:01.728701 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-57bb95dfb6-k69qk" Jul 15 16:48:01.942434 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:01.942392 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gkmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 16:48:01.942841 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:01.942468 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" podUID="3a8c1955-28be-438c-ab0f-488ddeb183bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 16:48:02.941979 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:02.941943 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gkmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 16:48:02.942189 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:02.942063 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" podUID="3a8c1955-28be-438c-ab0f-488ddeb183bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 16:48:03.942494 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:03.942455 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gkmxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 15 16:48:03.942979 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:03.942518 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" podUID="3a8c1955-28be-438c-ab0f-488ddeb183bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 15 16:48:04.945246 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:04.945219 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:48:04.945860 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:04.945589 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:48:04.946593 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:04.946570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gkmxk" Jul 15 16:48:06.726119 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:06.726088 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-s47ch" Jul 15 16:48:19.243715 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.243680 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb"] Jul 15 16:48:19.248626 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.248606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.252114 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.252094 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 16:48:19.252235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.252093 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpv6f\"" Jul 15 16:48:19.252235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.252094 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 16:48:19.252235 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.252099 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 16:48:19.258704 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.258679 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb"] Jul 15 16:48:19.365296 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.365265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.365468 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.365322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.365468 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.365382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.365468 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.365420 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldpfr\" (UniqueName: \"kubernetes.io/projected/66d7724c-98f7-4088-8833-7017485eb59e-kube-api-access-ldpfr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.365585 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.365515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d7724c-98f7-4088-8833-7017485eb59e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.365585 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.365535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466250 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466404 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466404 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466404 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldpfr\" (UniqueName: \"kubernetes.io/projected/66d7724c-98f7-4088-8833-7017485eb59e-kube-api-access-ldpfr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466404 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d7724c-98f7-4088-8833-7017485eb59e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466404 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466718 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466691 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466804 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466782 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.466859 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.466810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.468521 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.468503 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d7724c-98f7-4088-8833-7017485eb59e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.468848 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.468827 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d7724c-98f7-4088-8833-7017485eb59e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.475482 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.475464 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldpfr\" (UniqueName: \"kubernetes.io/projected/66d7724c-98f7-4088-8833-7017485eb59e-kube-api-access-ldpfr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb\" (UID: \"66d7724c-98f7-4088-8833-7017485eb59e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.559878 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.559789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:19.701756 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.701725 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb"] Jul 15 16:48:19.704370 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:48:19.704337 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d7724c_98f7_4088_8833_7017485eb59e.slice/crio-a4d4aafc77742790ddd637815e364c101c9902052c4794be5c4d94439f73b98a WatchSource:0}: Error finding container a4d4aafc77742790ddd637815e364c101c9902052c4794be5c4d94439f73b98a: Status 404 returned error can't find the container with id a4d4aafc77742790ddd637815e364c101c9902052c4794be5c4d94439f73b98a Jul 15 16:48:19.837527 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:19.837447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" event={"ID":"66d7724c-98f7-4088-8833-7017485eb59e","Type":"ContainerStarted","Data":"a4d4aafc77742790ddd637815e364c101c9902052c4794be5c4d94439f73b98a"} Jul 15 16:48:20.843937 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:20.843899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" event={"ID":"66d7724c-98f7-4088-8833-7017485eb59e","Type":"ContainerStarted","Data":"4e20f2956d2b89345bb69675fd2bf62b129dbfba3a3880ddd06e5fe3efdaeecb"} Jul 15 16:48:20.863503 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:20.863455 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" podStartSLOduration=0.835770319 podStartE2EDuration="1.863440373s" totalImagesPullingTime="1.027670054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:20.862532341 +0000 UTC m=+676.546781558" watchObservedRunningTime="2026-07-15 16:48:20.863440373 +0000 UTC m=+676.547689637" Jul 15 16:48:29.560911 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:29.560869 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:29.561575 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:29.560945 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:29.574050 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:29.574009 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:29.895587 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:29.895497 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb" Jul 15 16:48:33.362557 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.362522 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr"] Jul 15 16:48:33.365968 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.365946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.368243 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.368219 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 15 16:48:33.380416 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.380385 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr"] Jul 15 16:48:33.395741 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.395706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a048d5-46fa-45f0-b110-8aa411c2425a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.395921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.395754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.395921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.395771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.395921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.395821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.395921 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.395893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.396080 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.395938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvkp\" (UniqueName: \"kubernetes.io/projected/36a048d5-46fa-45f0-b110-8aa411c2425a-kube-api-access-7dvkp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.496903 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.496867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.496903 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.496904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.497193 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.496950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.497193 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.496979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.497193 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.497044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvkp\" (UniqueName: \"kubernetes.io/projected/36a048d5-46fa-45f0-b110-8aa411c2425a-kube-api-access-7dvkp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.497193 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.497116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a048d5-46fa-45f0-b110-8aa411c2425a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.497389 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.497351 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.497442 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.497393 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.497442 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.497407 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.499424 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.499394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a048d5-46fa-45f0-b110-8aa411c2425a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.499780 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.499760 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a048d5-46fa-45f0-b110-8aa411c2425a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.505974 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.505946 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvkp\" (UniqueName: \"kubernetes.io/projected/36a048d5-46fa-45f0-b110-8aa411c2425a-kube-api-access-7dvkp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztrkr\" (UID: \"36a048d5-46fa-45f0-b110-8aa411c2425a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.676849 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.676752 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:33.815977 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.815949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr"] Jul 15 16:48:33.817975 ip-10-0-142-145 kubenswrapper[2565]: W0715 16:48:33.817939 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a048d5_46fa_45f0_b110_8aa411c2425a.slice/crio-dc76a50bfffb4a61d2674bb1e0bd8236ed74224b3584de18fe082d4be291c23a WatchSource:0}: Error finding container dc76a50bfffb4a61d2674bb1e0bd8236ed74224b3584de18fe082d4be291c23a: Status 404 returned error can't find the container with id dc76a50bfffb4a61d2674bb1e0bd8236ed74224b3584de18fe082d4be291c23a Jul 15 16:48:33.902867 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:33.902831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" event={"ID":"36a048d5-46fa-45f0-b110-8aa411c2425a","Type":"ContainerStarted","Data":"dc76a50bfffb4a61d2674bb1e0bd8236ed74224b3584de18fe082d4be291c23a"} Jul 15 16:48:34.908307 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:34.908269 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" event={"ID":"36a048d5-46fa-45f0-b110-8aa411c2425a","Type":"ContainerStarted","Data":"26fff14e89eff04812803525cd5610b2146611a7012db7dbb6843722ed437924"} Jul 15 16:48:34.937455 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:34.937385 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" podStartSLOduration=1.750639084 podStartE2EDuration="1.937363902s" totalImagesPullingTime="186.724818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:34.936271323 +0000 UTC m=+690.620520549" watchObservedRunningTime="2026-07-15 16:48:34.937363902 +0000 UTC m=+690.621613128" Jul 15 16:48:43.676911 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:43.676876 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:43.677443 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:43.676945 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:43.689685 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:43.689656 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:48:43.960433 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:48:43.960342 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztrkr" Jul 15 16:52:04.818591 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:52:04.818505 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:52:04.821085 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:52:04.821065 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:52:04.826131 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:52:04.826105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:52:04.828221 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:52:04.828162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:57:04.849862 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:57:04.849834 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:57:04.856664 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:57:04.856638 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 16:57:04.857743 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:57:04.857721 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 16:57:04.863532 ip-10-0-142-145 kubenswrapper[2565]: I0715 16:57:04.863513 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 17:00:00.186529 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:00.186490 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt"] Jul 15 17:00:00.189980 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:00.189962 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt" Jul 15 17:00:00.193894 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:00.193864 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4f7sc\"" Jul 15 17:00:00.199309 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:00.199292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt" Jul 15 17:00:00.221565 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:00.221524 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt"] Jul 15 17:00:00.556808 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:00.556781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt"] Jul 15 17:00:00.559594 ip-10-0-142-145 kubenswrapper[2565]: W0715 17:00:00.559561 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62768d82_a76d_4d86_af73_a265a6895ac4.slice/crio-540d60ad7e7f7641d1b82296fc56eaa50ea577af7a26add29462254cee8d416e WatchSource:0}: Error finding container 540d60ad7e7f7641d1b82296fc56eaa50ea577af7a26add29462254cee8d416e: Status 404 returned error can't find the container with id 540d60ad7e7f7641d1b82296fc56eaa50ea577af7a26add29462254cee8d416e Jul 15 17:00:00.561369 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:00.561352 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 17:00:01.047039 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:01.046982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt" event={"ID":"62768d82-a76d-4d86-af73-a265a6895ac4","Type":"ContainerStarted","Data":"540d60ad7e7f7641d1b82296fc56eaa50ea577af7a26add29462254cee8d416e"} Jul 15 17:00:08.080640 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:08.080557 2565 generic.go:356] "Generic (PLEG): container finished" podID="62768d82-a76d-4d86-af73-a265a6895ac4" containerID="42422ebc311f55c29b22cfd722a134dbf1ea0b415c6488e7ab15ce94e5101eb8" exitCode=0 Jul 15 17:00:08.081094 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:08.080639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt" event={"ID":"62768d82-a76d-4d86-af73-a265a6895ac4","Type":"ContainerDied","Data":"42422ebc311f55c29b22cfd722a134dbf1ea0b415c6488e7ab15ce94e5101eb8"} Jul 15 17:00:09.218356 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:09.218335 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt" Jul 15 17:00:10.090939 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:10.090909 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt" Jul 15 17:00:10.090939 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:10.090935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735580-9gkbt" event={"ID":"62768d82-a76d-4d86-af73-a265a6895ac4","Type":"ContainerDied","Data":"540d60ad7e7f7641d1b82296fc56eaa50ea577af7a26add29462254cee8d416e"} Jul 15 17:00:10.091173 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:00:10.090976 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="540d60ad7e7f7641d1b82296fc56eaa50ea577af7a26add29462254cee8d416e" Jul 15 17:02:04.878889 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:02:04.878859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 17:02:04.887313 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:02:04.887280 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 17:02:04.887598 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:02:04.887580 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 17:02:04.900773 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:02:04.900734 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4d858_5a45789b-c3c4-4910-8388-8ee23bf1d4af/ovn-acl-logging/0.log" Jul 15 17:03:39.469757 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:39.469723 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f48c5d8-m9cqw_3c817e08-74d8-4e02-b687-2e8fed4d73b4/manager/0.log" Jul 15 17:03:39.482658 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:39.482631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f48c5d8-m9cqw_3c817e08-74d8-4e02-b687-2e8fed4d73b4/copy-manifests/0.log" Jul 15 17:03:39.856003 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:39.855977 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-57bb95dfb6-k69qk_c2045cd5-f276-40db-a3c1-e11024f88fc2/maas-api/0.log" Jul 15 17:03:39.974124 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:39.974093 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735580-9gkbt_62768d82-a76d-4d86-af73-a265a6895ac4/cleanup/0.log" Jul 15 17:03:40.109833 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:40.109763 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jtkgd_7ed7026c-605d-4ae0-97ce-e0feb02478c5/postgres/0.log" Jul 15 17:03:43.030131 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:43.030100 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6z446_cf896586-6e95-470a-8ad6-46d4dce406de/discovery/0.log" Jul 15 17:03:43.410895 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:43.410818 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gkmxk_3a8c1955-28be-438c-ab0f-488ddeb183bc/istio-proxy/1.log" Jul 15 17:03:43.687554 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:43.687482 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s47ch_c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19/payload-processing/0.log" Jul 15 17:03:44.181269 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:44.181242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4bmlb_66d7724c-98f7-4088-8833-7017485eb59e/main/0.log" Jul 15 17:03:44.409816 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:44.409788 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ztrkr_36a048d5-46fa-45f0-b110-8aa411c2425a/main/0.log" Jul 15 17:03:54.089497 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:54.089454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vkt8f_373f1b76-aa65-4f5c-a05e-77de22119a3d/global-pull-secret-syncer/0.log" Jul 15 17:03:54.170120 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:54.170075 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mkl2m_3b615616-22a1-4167-bd7e-404c257160b4/konnectivity-agent/0.log" Jul 15 17:03:54.276777 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:03:54.276747 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-145.ec2.internal_7bbefd012d364337eca5b8c7e595d372/haproxy/0.log" Jul 15 17:04:01.955798 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:01.955763 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bq4rh_0d5115b9-d105-4b63-8d63-286e4b370c6c/kube-state-metrics/0.log" Jul 15 17:04:01.976472 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:01.976449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bq4rh_0d5115b9-d105-4b63-8d63-286e4b370c6c/kube-rbac-proxy-main/0.log" Jul 15 17:04:02.004225 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.004205 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bq4rh_0d5115b9-d105-4b63-8d63-286e4b370c6c/kube-rbac-proxy-self/0.log" Jul 15 17:04:02.030564 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.030503 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-778f7fffd9-fjc5p_11f7d913-c732-40b1-98c5-d70d23995305/metrics-server/0.log" Jul 15 17:04:02.178440 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.178410 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9chzs_a02fffb1-68a8-48bd-be4e-9770ea034dab/node-exporter/0.log" Jul 15 17:04:02.200095 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.200074 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9chzs_a02fffb1-68a8-48bd-be4e-9770ea034dab/kube-rbac-proxy/0.log" Jul 15 17:04:02.224480 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.224453 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9chzs_a02fffb1-68a8-48bd-be4e-9770ea034dab/init-textfile/0.log" Jul 15 17:04:02.425148 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.425120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9897e34d-d306-4f39-8e27-dcf20f2a6aee/prometheus/0.log" Jul 15 17:04:02.448067 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.448038 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9897e34d-d306-4f39-8e27-dcf20f2a6aee/config-reloader/0.log" Jul 15 17:04:02.473251 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.473227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9897e34d-d306-4f39-8e27-dcf20f2a6aee/thanos-sidecar/0.log" Jul 15 17:04:02.495331 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.495308 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9897e34d-d306-4f39-8e27-dcf20f2a6aee/kube-rbac-proxy-web/0.log" Jul 15 17:04:02.516519 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.516496 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9897e34d-d306-4f39-8e27-dcf20f2a6aee/kube-rbac-proxy/0.log" Jul 15 17:04:02.540434 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.540408 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9897e34d-d306-4f39-8e27-dcf20f2a6aee/kube-rbac-proxy-thanos/0.log" Jul 15 17:04:02.562145 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:02.562121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9897e34d-d306-4f39-8e27-dcf20f2a6aee/init-config-reloader/0.log" Jul 15 17:04:03.982950 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:03.982922 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-shtqb_ffed9776-650c-4fb3-be21-14853570c7b5/networking-console-plugin/0.log" Jul 15 17:04:04.188670 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.188636 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s"] Jul 15 17:04:04.189113 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.189096 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62768d82-a76d-4d86-af73-a265a6895ac4" containerName="cleanup" Jul 15 17:04:04.189219 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.189115 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62768d82-a76d-4d86-af73-a265a6895ac4" containerName="cleanup" Jul 15 17:04:04.189278 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.189231 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62768d82-a76d-4d86-af73-a265a6895ac4" containerName="cleanup" Jul 15 17:04:04.192708 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.192676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.195267 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.195248 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2m4bp\"/\"openshift-service-ca.crt\"" Jul 15 17:04:04.196116 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.196097 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2m4bp\"/\"default-dockercfg-r28gz\"" Jul 15 17:04:04.196213 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.196125 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2m4bp\"/\"kube-root-ca.crt\"" Jul 15 17:04:04.203357 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.203315 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s"] Jul 15 17:04:04.290363 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.290268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmk62\" (UniqueName: \"kubernetes.io/projected/a7735698-0dd5-40ed-b0f9-8d543bc1c496-kube-api-access-dmk62\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.290363 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.290326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-sys\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.290563 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.290396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-lib-modules\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.290563 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.290490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-proc\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.290563 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.290517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-podres\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391319 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-proc\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391319 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-podres\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391542 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmk62\" (UniqueName: \"kubernetes.io/projected/a7735698-0dd5-40ed-b0f9-8d543bc1c496-kube-api-access-dmk62\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391542 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-sys\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391542 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-lib-modules\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391542 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391435 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-proc\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391542 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391483 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-podres\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391542 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-sys\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.391729 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.391572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7735698-0dd5-40ed-b0f9-8d543bc1c496-lib-modules\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.400496 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.400461 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmk62\" (UniqueName: \"kubernetes.io/projected/a7735698-0dd5-40ed-b0f9-8d543bc1c496-kube-api-access-dmk62\") pod \"perf-node-gather-daemonset-hxc7s\" (UID: \"a7735698-0dd5-40ed-b0f9-8d543bc1c496\") " pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.504677 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.504645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:04.642956 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.642927 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s"] Jul 15 17:04:04.644910 ip-10-0-142-145 kubenswrapper[2565]: W0715 17:04:04.644882 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda7735698_0dd5_40ed_b0f9_8d543bc1c496.slice/crio-4e4cc36809aed116e723de89cf8598c4209c4499aa61babf490ab6e4ee6adf69 WatchSource:0}: Error finding container 4e4cc36809aed116e723de89cf8598c4209c4499aa61babf490ab6e4ee6adf69: Status 404 returned error can't find the container with id 4e4cc36809aed116e723de89cf8598c4209c4499aa61babf490ab6e4ee6adf69 Jul 15 17:04:04.666203 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.666173 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/1.log" Jul 15 17:04:04.672747 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:04.672723 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vwvwt_d6ef26f3-a755-4e38-a7da-9a18a3133b1f/console-operator/2.log" Jul 15 17:04:05.176438 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:05.176401 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-w28wt_fed2e660-9bca-418e-a5a2-e4ef08969713/download-server/0.log" Jul 15 17:04:05.191732 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:05.191703 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" event={"ID":"a7735698-0dd5-40ed-b0f9-8d543bc1c496","Type":"ContainerStarted","Data":"d265b6286c2e4e884ea1cb24a41adf4728591d81fde296c9fe58ce7206313772"} Jul 15 17:04:05.191895 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:05.191750 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" event={"ID":"a7735698-0dd5-40ed-b0f9-8d543bc1c496","Type":"ContainerStarted","Data":"4e4cc36809aed116e723de89cf8598c4209c4499aa61babf490ab6e4ee6adf69"} Jul 15 17:04:05.191895 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:05.191847 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:06.908946 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:06.908909 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wrl48_261fea66-f664-4622-93ce-2e5bfcf6d5b4/dns/0.log" Jul 15 17:04:06.929489 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:06.929456 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wrl48_261fea66-f664-4622-93ce-2e5bfcf6d5b4/kube-rbac-proxy/0.log" Jul 15 17:04:06.955682 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:06.955644 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9q65d_8e5ab3dc-0270-4329-9cd3-cc883bcbd5b4/dns-node-resolver/0.log" Jul 15 17:04:07.636348 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:07.636319 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w9czq_1b7e6012-1e83-42e3-a85d-abb838b5661f/node-ca/0.log" Jul 15 17:04:08.666042 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:08.666000 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6z446_cf896586-6e95-470a-8ad6-46d4dce406de/discovery/0.log" Jul 15 17:04:08.751272 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:08.751245 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gkmxk_3a8c1955-28be-438c-ab0f-488ddeb183bc/istio-proxy/0.log" Jul 15 17:04:08.772251 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:08.772217 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gkmxk_3a8c1955-28be-438c-ab0f-488ddeb183bc/istio-proxy/1.log" Jul 15 17:04:08.831267 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:08.831225 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s47ch_c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19/payload-processing/0.log" Jul 15 17:04:09.470205 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:09.470173 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8d5nb_57543dc7-126e-4692-ac17-a891fb0e71b2/serve-healthcheck-canary/0.log" Jul 15 17:04:10.240405 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:10.240378 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txp5c_2be53ffe-4f8b-4bef-a2e7-6e2764c38b24/kube-rbac-proxy/0.log" Jul 15 17:04:10.275366 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:10.275346 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txp5c_2be53ffe-4f8b-4bef-a2e7-6e2764c38b24/exporter/0.log" Jul 15 17:04:10.301836 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:10.301814 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txp5c_2be53ffe-4f8b-4bef-a2e7-6e2764c38b24/extractor/0.log" Jul 15 17:04:11.206369 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:11.206344 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" Jul 15 17:04:11.233662 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:11.233611 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2m4bp/perf-node-gather-daemonset-hxc7s" podStartSLOduration=7.233594976 podStartE2EDuration="7.233594976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:04:05.221164766 +0000 UTC m=+1620.905413992" watchObservedRunningTime="2026-07-15 17:04:11.233594976 +0000 UTC m=+1626.917844203" Jul 15 17:04:13.061796 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:13.061765 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f48c5d8-m9cqw_3c817e08-74d8-4e02-b687-2e8fed4d73b4/manager/0.log" Jul 15 17:04:13.091304 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:13.091277 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f48c5d8-m9cqw_3c817e08-74d8-4e02-b687-2e8fed4d73b4/copy-manifests/0.log" Jul 15 17:04:14.443777 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:14.443748 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cf9875599-7dfvg_1fecd449-c71d-4fec-95b6-6cf702d54617/manager/0.log" Jul 15 17:04:14.502345 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:14.502315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6z446_cf896586-6e95-470a-8ad6-46d4dce406de/discovery/0.log" Jul 15 17:04:14.553605 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:14.553578 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gkmxk_3a8c1955-28be-438c-ab0f-488ddeb183bc/istio-proxy/0.log" Jul 15 17:04:14.575991 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:14.575969 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gkmxk_3a8c1955-28be-438c-ab0f-488ddeb183bc/istio-proxy/1.log" Jul 15 17:04:14.614727 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:14.614699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s47ch_c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19/payload-processing/0.log" Jul 15 17:04:15.749945 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:15.749915 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6z446_cf896586-6e95-470a-8ad6-46d4dce406de/discovery/0.log" Jul 15 17:04:15.798202 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:15.798181 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gkmxk_3a8c1955-28be-438c-ab0f-488ddeb183bc/istio-proxy/0.log" Jul 15 17:04:15.821070 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:15.821049 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gkmxk_3a8c1955-28be-438c-ab0f-488ddeb183bc/istio-proxy/1.log" Jul 15 17:04:15.863010 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:15.862983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s47ch_c452bfa4-1d8f-4ce8-aa9c-2f83120ddf19/payload-processing/0.log" Jul 15 17:04:19.673030 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:19.672981 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qz6dp_4c3c3421-39b0-4cee-8ddb-741f8a534108/kube-storage-version-migrator-operator/1.log" Jul 15 17:04:19.674087 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:19.674064 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qz6dp_4c3c3421-39b0-4cee-8ddb-741f8a534108/kube-storage-version-migrator-operator/0.log" Jul 15 17:04:20.798496 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.798466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7cc7c_d4152ad8-b5c8-4b6a-ad9e-8378eaa7d26f/kube-multus/0.log" Jul 15 17:04:20.856910 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.856883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8pmdx_df14dead-eee8-4fc4-8e75-e7bebb67aeec/kube-multus-additional-cni-plugins/0.log" Jul 15 17:04:20.878931 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.878909 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8pmdx_df14dead-eee8-4fc4-8e75-e7bebb67aeec/egress-router-binary-copy/0.log" Jul 15 17:04:20.901480 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.901457 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8pmdx_df14dead-eee8-4fc4-8e75-e7bebb67aeec/cni-plugins/0.log" Jul 15 17:04:20.923580 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.923554 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8pmdx_df14dead-eee8-4fc4-8e75-e7bebb67aeec/bond-cni-plugin/0.log" Jul 15 17:04:20.944793 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.944771 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8pmdx_df14dead-eee8-4fc4-8e75-e7bebb67aeec/routeoverride-cni/0.log" Jul 15 17:04:20.968175 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.968145 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8pmdx_df14dead-eee8-4fc4-8e75-e7bebb67aeec/whereabouts-cni-bincopy/0.log" Jul 15 17:04:20.990518 ip-10-0-142-145 kubenswrapper[2565]: I0715 17:04:20.990494 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8pmdx_df14dead-eee8-4fc4-8e75-e7bebb67aeec/whereabouts-cni/0.log"