Jul 17 13:18:50.196469 ip-10-0-132-223 systemd[1]: Starting Kubernetes Kubelet... Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.651565 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660642 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660665 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660669 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660672 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660675 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660678 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660683 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:18:50.697774 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660686 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660689 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660692 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660695 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660698 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660701 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660704 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660708 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660713 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660717 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660720 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660723 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660726 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660729 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660731 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660735 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660738 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660741 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660743 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:18:50.958342 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660746 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660749 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660752 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660754 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660757 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660760 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660764 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660767 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660770 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660773 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660775 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660779 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660781 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660784 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660786 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660789 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660792 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660795 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660798 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660801 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:18:50.970759 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660804 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:18:50.752283 ip-10-0-132-223 systemd[1]: Started Kubernetes Kubelet. Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660806 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660809 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660811 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660814 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660816 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660819 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660822 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660824 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660827 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660830 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660832 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660835 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660839 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660842 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660845 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660848 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660850 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660853 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660856 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:18:50.972205 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660858 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660862 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660864 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660867 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660870 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660872 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660875 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660878 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660881 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660883 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660886 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660888 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660891 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660894 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660896 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660899 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660903 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660908 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660912 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:18:50.973019 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660916 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660918 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660921 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660924 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660927 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660930 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660932 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660935 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660937 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660940 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660942 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660945 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660947 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.660950 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661708 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661716 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661719 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661722 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661725 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661727 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:18:50.974997 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661730 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661733 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661735 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661738 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661741 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661744 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661746 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661750 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661752 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661755 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661757 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661761 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661764 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661767 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661769 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661774 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661778 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661781 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661783 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:18:50.977650 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661787 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661790 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661793 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661795 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661799 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661802 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661805 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661810 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661813 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661816 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661818 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661821 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661825 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661828 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661831 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661834 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661837 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661841 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661844 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:18:50.979600 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661846 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661849 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661852 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661855 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661858 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661860 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661863 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661866 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661868 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661871 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661874 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661876 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661878 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661881 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661884 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661886 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661888 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661891 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661893 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661896 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:18:50.980580 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661900 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661902 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661905 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661907 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661909 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661912 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661916 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661918 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661921 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661924 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661928 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661931 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661934 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661937 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661939 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661942 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661944 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661947 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661949 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:18:50.982570 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661956 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661958 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661961 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661963 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661966 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661968 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661970 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661973 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661975 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661978 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661980 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661982 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661985 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661989 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661991 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.661994 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662524 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662533 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662537 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662541 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:18:50.983896 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662547 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662550 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662555 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662561 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662565 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662570 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662575 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662580 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662584 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662588 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662592 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662595 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662600 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662604 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662608 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662611 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662615 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662618 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662624 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:18:50.984724 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662629 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662634 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662638 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662643 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662647 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662651 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662658 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662663 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662668 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662672 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662676 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662680 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662684 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662687 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662691 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662695 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662700 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662704 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662708 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662711 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:18:50.985487 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662714 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662718 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662722 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662725 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662729 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662733 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662737 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662741 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662745 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662749 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662753 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662756 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662760 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662763 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662767 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662770 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662774 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662779 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662785 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662789 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:18:50.986082 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662792 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662796 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662800 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662804 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662807 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662811 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662815 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662818 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662824 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662828 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662831 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662836 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662839 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662843 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662847 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662851 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662855 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662859 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662862 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662867 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:18:50.986875 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662871 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662875 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662878 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662881 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662885 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662889 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662893 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662897 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662901 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662905 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662910 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662914 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662918 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662921 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662925 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.662929 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663023 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663033 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663042 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663049 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663057 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 13:18:50.987486 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663062 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663068 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663078 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663083 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663087 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663092 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663097 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663102 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663107 2582 flags.go:64] FLAG: --cgroup-root="" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663111 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663114 2582 flags.go:64] FLAG: --client-ca-file="" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663119 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663122 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663127 2582 flags.go:64] FLAG: --cluster-domain="" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663130 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663133 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663136 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663139 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663157 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663161 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663164 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663169 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663172 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663175 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 13:18:50.988086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663178 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663182 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663184 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663188 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663192 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663194 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663197 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663202 2582 flags.go:64] FLAG: --enable-server="true" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663205 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663209 2582 flags.go:64] FLAG: --event-burst="100" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663212 2582 flags.go:64] FLAG: --event-qps="50" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663216 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663219 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663222 2582 flags.go:64] FLAG: --eviction-hard="" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663226 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663228 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663232 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663235 2582 flags.go:64] FLAG: --eviction-soft="" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663237 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663240 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663246 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663251 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663254 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663258 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663263 2582 flags.go:64] FLAG: --feature-gates="" Jul 17 13:18:50.988723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663268 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663271 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663275 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663279 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663284 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663288 2582 flags.go:64] FLAG: --help="false" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663291 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-132-223.ec2.internal" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663296 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663299 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663303 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663307 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663311 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663315 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663318 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663330 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663334 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663337 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663341 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663346 2582 flags.go:64] FLAG: --kube-reserved="" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663350 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663353 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663357 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663360 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663364 2582 flags.go:64] FLAG: --lock-file="" Jul 17 13:18:50.989469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663367 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663371 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663375 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663382 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663386 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663390 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663393 2582 flags.go:64] FLAG: --logging-format="text" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663397 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663401 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663405 2582 flags.go:64] FLAG: --manifest-url="" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663409 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663414 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663420 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663425 2582 flags.go:64] FLAG: --max-pods="110" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663429 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663433 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663438 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663442 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663447 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663451 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663456 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663467 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663472 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663477 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 13:18:50.990195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663481 2582 flags.go:64] FLAG: --pod-cidr="" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663485 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663492 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663497 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663501 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663505 2582 flags.go:64] FLAG: --port="10250" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663511 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663515 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-076fde5eaca4514db" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663520 2582 flags.go:64] FLAG: --qos-reserved="" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663524 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663529 2582 flags.go:64] FLAG: --register-node="true" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663532 2582 flags.go:64] FLAG: --register-with-taints="" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663538 2582 flags.go:64] FLAG: --registry-burst="10" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663543 2582 flags.go:64] FLAG: --registry-qps="5" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663547 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663551 2582 flags.go:64] FLAG: --reserved-memory="" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663557 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663561 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663566 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663570 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663576 2582 flags.go:64] FLAG: --runonce="false" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663580 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663584 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663588 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663592 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 13:18:50.990864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663596 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663600 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663604 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663609 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663613 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663617 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663624 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663628 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663632 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663636 2582 flags.go:64] FLAG: --system-cgroups="" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663640 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663648 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663652 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663656 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663663 2582 flags.go:64] FLAG: --tls-min-version="" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663667 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663671 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663675 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663680 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663684 2582 flags.go:64] FLAG: --v="2" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663690 2582 flags.go:64] FLAG: --version="false" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663697 2582 flags.go:64] FLAG: --vmodule="" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663703 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.663708 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 13:18:50.991829 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663873 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663881 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663887 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663893 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663897 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663901 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663905 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663909 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663912 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663916 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663920 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663923 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663927 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663930 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663935 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663940 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663944 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663948 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663952 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663956 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:18:50.992504 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663960 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663963 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663967 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663971 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663975 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663978 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663982 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663986 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663990 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663994 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.663999 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664003 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664007 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664011 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664015 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664020 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664024 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664027 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664031 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664035 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:18:51.213052 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664039 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664042 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664046 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664049 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664053 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664057 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664062 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664066 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664070 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664073 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664077 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664083 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664088 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664092 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664096 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664100 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664105 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664109 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664113 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:18:51.213751 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664117 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664121 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664162 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664168 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664173 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664177 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664181 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664185 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664190 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664194 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664198 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664203 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664207 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664211 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664215 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664219 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664223 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664226 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664230 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664235 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:18:51.214288 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664239 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664244 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664250 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664254 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664258 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664262 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664265 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664269 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664273 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664276 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664280 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664284 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664287 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664291 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664295 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664298 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664302 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664311 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664315 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:18:51.214851 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.664319 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.665166 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.672721 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.672740 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.673660 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.673668 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673735 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673741 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673745 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673749 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673754 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673757 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673760 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673765 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:18:51.215374 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673768 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673770 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673773 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673776 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673778 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673781 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673784 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673787 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673789 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673792 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673794 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673797 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673799 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673802 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673805 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673807 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673810 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673814 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673817 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:18:51.215893 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673821 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673824 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673828 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673830 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673833 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673836 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673838 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673841 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673844 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673847 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673849 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673852 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673857 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673860 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673862 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673865 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673867 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673870 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673873 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673875 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:18:51.216426 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673878 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673880 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673883 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673885 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673888 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673890 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673893 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673896 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673899 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673901 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673904 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673907 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673911 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673914 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673917 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673920 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673923 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673925 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673928 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673930 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:18:51.216976 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673933 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673935 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673938 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673940 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673944 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673947 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673950 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673952 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673955 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673959 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673962 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673965 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673968 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673971 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673974 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673976 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673979 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673982 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673984 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673987 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:18:51.217562 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673990 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673992 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673995 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.673997 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674001 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674004 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674006 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674009 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674012 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674015 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674017 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674020 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.674025 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674178 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674184 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:18:51.218118 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674186 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674190 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674194 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674196 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674199 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674202 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674204 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674207 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674209 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674212 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674214 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674217 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674219 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674222 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674224 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674227 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674229 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674232 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674235 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:18:51.218589 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674237 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674240 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674243 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674246 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674248 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674251 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674253 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674257 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674259 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674262 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674264 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674268 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674271 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674274 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674277 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674281 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674284 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674287 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674289 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:18:51.219123 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674292 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674295 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674297 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674300 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674303 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674305 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674308 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674310 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674313 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674315 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674318 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674321 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674323 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674326 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674328 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674332 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674334 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674337 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674339 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:18:51.219641 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674342 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674344 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674347 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674349 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674352 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674354 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674356 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674359 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674362 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674365 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674368 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674370 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674373 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674375 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674378 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674380 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674383 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674385 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674387 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674390 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:18:51.220197 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674394 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674397 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674400 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674402 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674405 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674407 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674410 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674412 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674416 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674419 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674421 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674424 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674426 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674430 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674433 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674437 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674439 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674442 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674445 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:18:51.220728 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:50.674447 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.674452 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.674576 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.677113 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.679066 2582 server.go:1019] "Starting client certificate rotation" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.679237 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.679281 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.682482 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.687677 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.705668 2582 log.go:25] "Validated CRI v1 runtime API" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.708179 2582 log.go:25] "Validated CRI v1 image API" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.709011 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:18:51.221279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.710692 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 13:18:51.221614 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.713287 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85e60a7e-5b8c-4e84-8368-0b07944bd875:/dev/nvme0n1p3 b8cc31e4-4621-4382-9a47-eed2e726dde2:/dev/nvme0n1p4] Jul 17 13:18:51.221614 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.713311 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.719399 2582 manager.go:216] Machine: {Timestamp:2026-07-17 13:18:50.717946548 +0000 UTC m=+0.386482278 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104979 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24168bb6547b8c0b29c64e054a48b1 SystemUUID:ec24168b-b654-7b8c-0b29-c64e054a48b1 BootID:a65b0c84-77ff-4ecf-9e01-254876be4e36 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:0c:ac:ae:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:0c:ac:ae:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:e3:20:70:66:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.719504 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.719584 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.723364 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.723394 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.724257 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.724267 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.724274 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.724288 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.726250 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731110 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731256 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731284 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731293 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731307 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731318 2582 kubelet.go:398] "Adding apiserver pod source" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731327 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 13:18:51.221783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731751 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.731772 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.735036 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.739346 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.739378 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741389 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741403 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741410 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741415 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741448 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741459 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741468 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741473 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741479 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741484 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741500 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.741506 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.743132 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.743133 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.743262 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.743271 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.747102 2582 server.go:1268] "Started kubelet" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.747200 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.751640 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.752988 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.754939 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.755360 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfw5g" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.757003 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.758373 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfw5g" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.758864 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.759132 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.759383 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-223.ec2.internal.18c3163d7eec35bf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-223.ec2.internal,UID:ip-10-0-132-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-223.ec2.internal,},FirstTimestamp:2026-07-17 13:18:50.747073983 +0000 UTC m=+0.415609712,LastTimestamp:2026-07-17 13:18:50.747073983 +0000 UTC m=+0.415609712,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-223.ec2.internal,}" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.769629 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.769637 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.769743 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.770419 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.770435 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.770452 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.770547 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.770555 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 17 13:18:51.222364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.772478 2582 factory.go:55] Registering systemd factory Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.772516 2582 factory.go:223] Registration of the systemd container factory successfully Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.772732 2582 factory.go:153] Registering CRI-O factory Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.772740 2582 factory.go:223] Registration of the crio container factory successfully Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.772786 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.772805 2582 factory.go:103] Registering Raw factory Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.772818 2582 manager.go:1196] Started watching for new ooms in manager Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.773207 2582 manager.go:349] Starting recovery of all containers Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.780667 2582 manager.go:354] Recovery completed Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.781889 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.784462 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-223.ec2.internal\" not found" node="ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.786408 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.788438 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.788464 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.788475 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.788925 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.788932 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.788934 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.788953 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.789611 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.789653 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.789670 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.791222 2582 policy_none.go:49] "None policy: Start" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.791236 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.791248 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.793222 2582 policy_none.go:47] "Start" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.825743 2582 manager.go:337] "Starting Device Plugin manager" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.825774 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.825784 2582 server.go:87] "Starting device plugin registration server" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.826076 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.826086 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.826206 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.826287 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.826295 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.826721 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.826768 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.840839 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.841949 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.841984 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.842003 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.842035 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.843815 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.926850 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.927805 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.927844 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.927855 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.927878 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.937065 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.223661 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.937091 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-223.ec2.internal\": node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.943034 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal"] Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.943091 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.944649 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.944677 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.944691 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947083 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947244 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947793 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947815 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947827 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947796 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947893 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.947904 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.950047 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.950074 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.950716 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.950733 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.950742 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:50.957864 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.970762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac1c64eb7fd1779affcc18145218f05a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"ac1c64eb7fd1779affcc18145218f05a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.970783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a444e4281a1962a7ac9260c67faa733a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-223.ec2.internal\" (UID: \"a444e4281a1962a7ac9260c67faa733a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:50.970798 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac1c64eb7fd1779affcc18145218f05a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"ac1c64eb7fd1779affcc18145218f05a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.007061 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-223.ec2.internal\" not found" node="ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.011736 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-223.ec2.internal\" not found" node="ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.058246 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.071510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a444e4281a1962a7ac9260c67faa733a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-223.ec2.internal\" (UID: \"a444e4281a1962a7ac9260c67faa733a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.437034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.071535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac1c64eb7fd1779affcc18145218f05a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"ac1c64eb7fd1779affcc18145218f05a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.071552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac1c64eb7fd1779affcc18145218f05a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"ac1c64eb7fd1779affcc18145218f05a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.071603 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac1c64eb7fd1779affcc18145218f05a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"ac1c64eb7fd1779affcc18145218f05a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.071613 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac1c64eb7fd1779affcc18145218f05a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal\" (UID: \"ac1c64eb7fd1779affcc18145218f05a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.071606 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a444e4281a1962a7ac9260c67faa733a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-223.ec2.internal\" (UID: \"a444e4281a1962a7ac9260c67faa733a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.158663 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.259321 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.315761 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.315785 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Jul 17 13:18:51.442652 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.359828 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.617066 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.460305 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.617066 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.560860 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.661385 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.677832 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.677954 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.677987 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.712700 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.761601 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.764738 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 13:13:51 +0000 UTC" deadline="2028-01-08 20:27:08.335488419 +0000 UTC" Jul 17 13:18:51.840342 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:51.764760 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12967h8m16.5707311s" Jul 17 13:18:52.028791 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.862424 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:52.028791 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:51.962725 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-223.ec2.internal\" not found" Jul 17 13:18:52.028791 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.006612 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:18:52.195081 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:52.068696 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda444e4281a1962a7ac9260c67faa733a.slice/crio-df8c3639ff8f84bb572bc14648bb5fcb82bf5f1fcd3566138be20615441a013b WatchSource:0}: Error finding container df8c3639ff8f84bb572bc14648bb5fcb82bf5f1fcd3566138be20615441a013b: Status 404 returned error can't find the container with id df8c3639ff8f84bb572bc14648bb5fcb82bf5f1fcd3566138be20615441a013b Jul 17 13:18:52.195081 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.070913 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" Jul 17 13:18:52.195081 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.073541 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:18:52.195081 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:52.081827 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1c64eb7fd1779affcc18145218f05a.slice/crio-4a689ea4c255fe3c1d0acdbd31cb3c2867dc00cf38b2dc324603ecd718c8c01b WatchSource:0}: Error finding container 4a689ea4c255fe3c1d0acdbd31cb3c2867dc00cf38b2dc324603ecd718c8c01b: Status 404 returned error can't find the container with id 4a689ea4c255fe3c1d0acdbd31cb3c2867dc00cf38b2dc324603ecd718c8c01b Jul 17 13:18:52.195081 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.083973 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:18:52.195081 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.085255 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" Jul 17 13:18:52.195081 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.093106 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:18:52.768704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.731616 2582 apiserver.go:52] "Watching apiserver" Jul 17 13:18:52.768704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.739935 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 13:18:52.768704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.740433 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-8dwh9","kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27","openshift-cluster-node-tuning-operator/tuned-fc4vm","openshift-dns/node-resolver-stwzb","openshift-image-registry/node-ca-pgkwb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal","openshift-multus/multus-99w2m","kube-system/global-pull-secret-syncer-vm9wl","openshift-multus/multus-additional-cni-plugins-vzln6","openshift-multus/network-metrics-daemon-wmxh4","openshift-network-diagnostics/network-check-target-s62bj","openshift-network-operator/iptables-alerter-cqwxv","openshift-ovn-kubernetes/ovnkube-node-2js58"] Jul 17 13:18:52.768704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.743245 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.768704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.746375 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:52.768704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.748930 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.768704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.751324 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.771006 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.770676 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 13:18:52.774147 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.773422 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 13:18:52.774147 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.773433 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 13:18:52.774147 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.773888 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 13:18:52.774147 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.774039 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 13:18:52.774147 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.774046 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j7kj6\"" Jul 17 13:18:52.775777 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.775201 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:52.775777 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.775700 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.776946 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.776967 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cxxl5\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777253 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pwzws\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777257 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tf5dz\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777342 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777367 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777990 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8t67x\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777397 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777534 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777579 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777342 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.778793 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.777585 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.780945 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.840545 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.840637 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.840754 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:52.840821 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:52.840808 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.841073 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-99w2m" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.841668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-sys-fs\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.841701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-modprobe-d\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.841728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cnibin\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.841833 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842494 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3dc8168-45aa-40fe-a855-69ce3f723bf8-iptables-alerter-script\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842562 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysctl-d\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92392aee-1962-4a2a-9e4e-c08db14444df-etc-tuned\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842702 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92392aee-1962-4a2a-9e4e-c08db14444df-tmp\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842771 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-systemd\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-var-lib-kubelet\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842831 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976s7\" (UniqueName: \"kubernetes.io/projected/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-kube-api-access-976s7\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3dc8168-45aa-40fe-a855-69ce3f723bf8-host-slash\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842892 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-sys\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.846536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842946 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmzb\" (UniqueName: \"kubernetes.io/projected/92392aee-1962-4a2a-9e4e-c08db14444df-kube-api-access-qcmzb\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.842978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9spj6\" (UniqueName: \"kubernetes.io/projected/84451f7e-4e57-4d73-8886-4ab6ae55c489-kube-api-access-9spj6\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843007 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-system-cni-dir\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cni-binary-copy\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-device-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysconfig\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843410 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-kubernetes\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843480 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-lib-modules\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-os-release\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843544 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843569 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94x2q\" (UniqueName: \"kubernetes.io/projected/c3dc8168-45aa-40fe-a855-69ce3f723bf8-kube-api-access-94x2q\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843579 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-socket-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-registration-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.847480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843674 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbpnq\" (UniqueName: \"kubernetes.io/projected/e341155b-9499-42cd-8171-d2b4a85435e3-kube-api-access-wbpnq\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysctl-conf\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-run\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84451f7e-4e57-4d73-8886-4ab6ae55c489-hosts-file\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843771 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84451f7e-4e57-4d73-8886-4ab6ae55c489-tmp-dir\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.843802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-host\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.845006 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.845985 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.846292 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l6w8x\"" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.846638 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.846886 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.847742 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:52.848422 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:52.847888 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.848435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.848548 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcrs9\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.849104 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.849201 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.849591 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.849835 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-86shz\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.849912 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cdnf8\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.850029 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.850546 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:52.850631 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:18:52.851854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.851482 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:18:52.852552 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.851561 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pr8kd" Jul 17 13:18:52.856881 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.855558 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" event={"ID":"ac1c64eb7fd1779affcc18145218f05a","Type":"ContainerStarted","Data":"4a689ea4c255fe3c1d0acdbd31cb3c2867dc00cf38b2dc324603ecd718c8c01b"} Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.857530 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" event={"ID":"a444e4281a1962a7ac9260c67faa733a","Type":"ContainerStarted","Data":"df8c3639ff8f84bb572bc14648bb5fcb82bf5f1fcd3566138be20615441a013b"} Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.872202 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.893703 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-cnibin\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944106 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-os-release\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmmks\" (UniqueName: \"kubernetes.io/projected/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-kube-api-access-qmmks\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-sys-fs\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944198 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-modprobe-d\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92392aee-1962-4a2a-9e4e-c08db14444df-etc-tuned\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944325 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92392aee-1962-4a2a-9e4e-c08db14444df-tmp\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c0ff472-2456-4cbb-a738-644225307091-dbus\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944375 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-run-netns\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944399 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-systemd\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944423 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-ovn\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944482 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-var-lib-kubelet\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.957153 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944592 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944653 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944688 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-modprobe-d\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944745 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-976s7\" (UniqueName: \"kubernetes.io/projected/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-kube-api-access-976s7\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944789 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-host\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-slash\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-etc-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944943 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.944956 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-sys\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945008 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmzb\" (UniqueName: \"kubernetes.io/projected/92392aee-1962-4a2a-9e4e-c08db14444df-kube-api-access-qcmzb\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9spj6\" (UniqueName: \"kubernetes.io/projected/84451f7e-4e57-4d73-8886-4ab6ae55c489-kube-api-access-9spj6\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-system-cni-dir\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cni-binary-copy\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945187 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-multus-certs\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqx9m\" (UniqueName: \"kubernetes.io/projected/f8ca89ae-7469-4635-b5d0-01f124a55d7a-kube-api-access-cqx9m\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945302 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-device-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:52.958504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945432 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-system-cni-dir\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945526 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945526 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-sys-fs\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945925 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-device-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945978 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-sys\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.945431 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946076 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-kubernetes\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946097 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cni-binary-copy\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovn-node-metrics-cert\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946161 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-var-lib-kubelet\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946162 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-hostroot\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-lib-modules\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-kubernetes\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946361 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-os-release\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946402 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-lib-modules\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946413 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-os-release\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.026833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-netns\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946491 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-cni-bin\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946550 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-cni-netd\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946590 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94x2q\" (UniqueName: \"kubernetes.io/projected/c3dc8168-45aa-40fe-a855-69ce3f723bf8-kube-api-access-94x2q\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946618 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-socket-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbpnq\" (UniqueName: \"kubernetes.io/projected/e341155b-9499-42cd-8171-d2b4a85435e3-kube-api-access-wbpnq\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946744 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysctl-conf\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946798 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84451f7e-4e57-4d73-8886-4ab6ae55c489-tmp-dir\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-host\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946841 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-serviceca\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c0ff472-2456-4cbb-a738-644225307091-kubelet-config\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946923 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-kubelet\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946947 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-var-lib-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946968 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovnkube-config\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946963 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-socket-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.946970 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysctl-conf\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.028169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cnibin\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947024 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-host\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa553e18-e0f0-4b20-928c-5b5418df0331-agent-certs\") pod \"konnectivity-agent-8dwh9\" (UID: \"aa553e18-e0f0-4b20-928c-5b5418df0331\") " pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-systemd-units\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947096 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-env-overrides\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3dc8168-45aa-40fe-a855-69ce3f723bf8-iptables-alerter-script\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysctl-d\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-socket-dir-parent\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947296 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-cni-multus\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947327 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-kubelet\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2rd\" (UniqueName: \"kubernetes.io/projected/ebb877da-9edc-4334-bf13-cf3baff2516f-kube-api-access-hh2rd\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947393 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84451f7e-4e57-4d73-8886-4ab6ae55c489-tmp-dir\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa553e18-e0f0-4b20-928c-5b5418df0331-konnectivity-ca\") pod \"konnectivity-agent-8dwh9\" (UID: \"aa553e18-e0f0-4b20-928c-5b5418df0331\") " pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947474 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-cnibin\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947482 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-systemd\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-cni-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.029758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebb877da-9edc-4334-bf13-cf3baff2516f-cni-binary-copy\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-etc-kubernetes\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947594 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysctl-d\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947614 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-log-socket\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947642 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-systemd\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovnkube-script-lib\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947706 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3dc8168-45aa-40fe-a855-69ce3f723bf8-iptables-alerter-script\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947738 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3dc8168-45aa-40fe-a855-69ce3f723bf8-host-slash\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947774 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysconfig\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947807 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3dc8168-45aa-40fe-a855-69ce3f723bf8-host-slash\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947850 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947867 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-etc-sysconfig\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947909 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-conf-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.947961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-node-log\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948070 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-daemon-config\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.031564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-system-cni-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-k8s-cni-cncf-io\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmc6k\" (UniqueName: \"kubernetes.io/projected/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-kube-api-access-tmc6k\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-registration-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-run\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948334 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948356 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e341155b-9499-42cd-8171-d2b4a85435e3-registration-dir\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84451f7e-4e57-4d73-8886-4ab6ae55c489-hosts-file\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948436 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84451f7e-4e57-4d73-8886-4ab6ae55c489-hosts-file\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948456 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92392aee-1962-4a2a-9e4e-c08db14444df-run\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-cni-bin\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.948513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.949020 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92392aee-1962-4a2a-9e4e-c08db14444df-tmp\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.949042 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92392aee-1962-4a2a-9e4e-c08db14444df-etc-tuned\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.954347 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-976s7\" (UniqueName: \"kubernetes.io/projected/1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be-kube-api-access-976s7\") pod \"multus-additional-cni-plugins-vzln6\" (UID: \"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be\") " pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.956682 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94x2q\" (UniqueName: \"kubernetes.io/projected/c3dc8168-45aa-40fe-a855-69ce3f723bf8-kube-api-access-94x2q\") pod \"iptables-alerter-cqwxv\" (UID: \"c3dc8168-45aa-40fe-a855-69ce3f723bf8\") " pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:53.032497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.957315 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmzb\" (UniqueName: \"kubernetes.io/projected/92392aee-1962-4a2a-9e4e-c08db14444df-kube-api-access-qcmzb\") pod \"tuned-fc4vm\" (UID: \"92392aee-1962-4a2a-9e4e-c08db14444df\") " pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.033814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.957663 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9spj6\" (UniqueName: \"kubernetes.io/projected/84451f7e-4e57-4d73-8886-4ab6ae55c489-kube-api-access-9spj6\") pod \"node-resolver-stwzb\" (UID: \"84451f7e-4e57-4d73-8886-4ab6ae55c489\") " pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:53.033814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:52.960503 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbpnq\" (UniqueName: \"kubernetes.io/projected/e341155b-9499-42cd-8171-d2b4a85435e3-kube-api-access-wbpnq\") pod \"aws-ebs-csi-driver-node-qlt27\" (UID: \"e341155b-9499-42cd-8171-d2b4a85435e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.059463 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-log-socket\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059503 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovnkube-script-lib\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059528 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-conf-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.059623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059572 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-node-log\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-daemon-config\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.059623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-system-cni-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059638 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-k8s-cni-cncf-io\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059666 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmc6k\" (UniqueName: \"kubernetes.io/projected/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-kube-api-access-tmc6k\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059721 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-cni-bin\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-cnibin\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-os-release\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmmks\" (UniqueName: \"kubernetes.io/projected/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-kube-api-access-qmmks\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059859 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c0ff472-2456-4cbb-a738-644225307091-dbus\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059886 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-run-netns\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-systemd\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-ovn\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.059977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059964 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-host\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.059988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-slash\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-etc-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-multus-certs\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060074 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqx9m\" (UniqueName: \"kubernetes.io/projected/f8ca89ae-7469-4635-b5d0-01f124a55d7a-kube-api-access-cqx9m\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovn-node-metrics-cert\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-hostroot\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-netns\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060250 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-cni-bin\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-cni-netd\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060309 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-serviceca\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c0ff472-2456-4cbb-a738-644225307091-kubelet-config\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-kubelet\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060393 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-var-lib-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060421 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovnkube-config\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa553e18-e0f0-4b20-928c-5b5418df0331-agent-certs\") pod \"konnectivity-agent-8dwh9\" (UID: \"aa553e18-e0f0-4b20-928c-5b5418df0331\") " pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:53.060648 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-systemd-units\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-env-overrides\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060536 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-socket-dir-parent\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060562 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-cni-multus\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060588 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-kubelet\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2rd\" (UniqueName: \"kubernetes.io/projected/ebb877da-9edc-4334-bf13-cf3baff2516f-kube-api-access-hh2rd\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa553e18-e0f0-4b20-928c-5b5418df0331-konnectivity-ca\") pod \"konnectivity-agent-8dwh9\" (UID: \"aa553e18-e0f0-4b20-928c-5b5418df0331\") " pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-cni-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060726 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebb877da-9edc-4334-bf13-cf3baff2516f-cni-binary-copy\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-etc-kubernetes\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060850 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-etc-kubernetes\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060905 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-log-socket\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.061472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.060957 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.062127 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.061641 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovnkube-script-lib\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.062127 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.061712 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-conf-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.062127 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.061755 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.062127 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.061795 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-node-log\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.062371 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062347 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-daemon-config\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.062441 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062420 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-system-cni-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.062501 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062469 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-k8s-cni-cncf-io\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.062785 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062756 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-systemd-units\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.062877 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-netns\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.062877 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062842 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-cni-bin\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.062981 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062901 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-cni-netd\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.062981 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.062931 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-cni-bin\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063143 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.062985 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:53.063143 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063012 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063143 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.063055 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs podName:f8ca89ae-7469-4635-b5d0-01f124a55d7a nodeName:}" failed. No retries permitted until 2026-07-17 13:18:53.563028852 +0000 UTC m=+3.231564592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs") pod "network-metrics-daemon-wmxh4" (UID: "f8ca89ae-7469-4635-b5d0-01f124a55d7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:53.063350 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063153 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-os-release\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.063350 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063156 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-env-overrides\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063350 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063295 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c0ff472-2456-4cbb-a738-644225307091-dbus\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.063350 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063337 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-run-netns\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063568 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063383 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-systemd\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063568 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063428 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-run-ovn\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063568 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-host\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.063568 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063491 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-socket-dir-parent\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.063568 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063507 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-serviceca\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.063568 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063557 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-cni-multus\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.063568 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063562 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-etc-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063901 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063596 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-run-multus-certs\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.063901 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063616 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c0ff472-2456-4cbb-a738-644225307091-kubelet-config\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.063901 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063654 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-host-var-lib-kubelet\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.063901 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063703 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-kubelet\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.063901 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063745 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-var-lib-openvswitch\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.064274 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-multus-cni-dir\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.064337 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-hostroot\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.064355 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.064399 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebb877da-9edc-4334-bf13-cf3baff2516f-cnibin\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.064404 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa553e18-e0f0-4b20-928c-5b5418df0331-konnectivity-ca\") pod \"konnectivity-agent-8dwh9\" (UID: \"aa553e18-e0f0-4b20-928c-5b5418df0331\") " pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.064426 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret podName:4c0ff472-2456-4cbb-a738-644225307091 nodeName:}" failed. No retries permitted until 2026-07-17 13:18:53.564391547 +0000 UTC m=+3.232927274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret") pod "global-pull-secret-syncer-vm9wl" (UID: "4c0ff472-2456-4cbb-a738-644225307091") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.063509 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-host-slash\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.064875 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.064869 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebb877da-9edc-4334-bf13-cf3baff2516f-cni-binary-copy\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.065381 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.065082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vzln6" Jul 17 13:18:53.067427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.067396 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovnkube-config\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.068286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.068259 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-ovn-node-metrics-cert\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.068989 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.068968 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:18:53.069073 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.068994 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:18:53.069073 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.069007 2582 projected.go:196] Error preparing data for projected volume kube-api-access-fm4q6 for pod openshift-network-diagnostics/network-check-target-s62bj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:53.069073 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.069058 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6 podName:c3f212e0-b175-4de3-9f0e-fb1139d3afe0 nodeName:}" failed. No retries permitted until 2026-07-17 13:18:53.569042268 +0000 UTC m=+3.237577987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fm4q6" (UniqueName: "kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6") pod "network-check-target-s62bj" (UID: "c3f212e0-b175-4de3-9f0e-fb1139d3afe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:53.071269 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.071238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmc6k\" (UniqueName: \"kubernetes.io/projected/8a0793a5-bee4-49aa-a461-97a58a7d5fc6-kube-api-access-tmc6k\") pod \"node-ca-pgkwb\" (UID: \"8a0793a5-bee4-49aa-a461-97a58a7d5fc6\") " pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.072733 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.072633 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" Jul 17 13:18:53.073052 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.073029 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2rd\" (UniqueName: \"kubernetes.io/projected/ebb877da-9edc-4334-bf13-cf3baff2516f-kube-api-access-hh2rd\") pod \"multus-99w2m\" (UID: \"ebb877da-9edc-4334-bf13-cf3baff2516f\") " pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.076059 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.076014 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqx9m\" (UniqueName: \"kubernetes.io/projected/f8ca89ae-7469-4635-b5d0-01f124a55d7a-kube-api-access-cqx9m\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:53.076155 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.076085 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa553e18-e0f0-4b20-928c-5b5418df0331-agent-certs\") pod \"konnectivity-agent-8dwh9\" (UID: \"aa553e18-e0f0-4b20-928c-5b5418df0331\") " pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:53.079692 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.079659 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6c1ce6_b0cb_48cb_b2e1_32cc96cfe7be.slice/crio-2f07a2104692ac70b64fa5806862c01e39adc7269ef6580a7ffb7a0efe2f6ba9 WatchSource:0}: Error finding container 2f07a2104692ac70b64fa5806862c01e39adc7269ef6580a7ffb7a0efe2f6ba9: Status 404 returned error can't find the container with id 2f07a2104692ac70b64fa5806862c01e39adc7269ef6580a7ffb7a0efe2f6ba9 Jul 17 13:18:53.081302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.081277 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmmks\" (UniqueName: \"kubernetes.io/projected/0ee56a7e-cf4e-4223-9840-f1799df0d9ac-kube-api-access-qmmks\") pod \"ovnkube-node-2js58\" (UID: \"0ee56a7e-cf4e-4223-9840-f1799df0d9ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.085348 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.085301 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode341155b_9499_42cd_8171_d2b4a85435e3.slice/crio-8cab3c51d53892256f718a3bf3fd113ab85ada45eabb76b1683c217df8ec987a WatchSource:0}: Error finding container 8cab3c51d53892256f718a3bf3fd113ab85ada45eabb76b1683c217df8ec987a: Status 404 returned error can't find the container with id 8cab3c51d53892256f718a3bf3fd113ab85ada45eabb76b1683c217df8ec987a Jul 17 13:18:53.143527 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.143492 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqwxv" Jul 17 13:18:53.148102 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.147940 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" Jul 17 13:18:53.156282 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.156248 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3dc8168_45aa_40fe_a855_69ce3f723bf8.slice/crio-e2545b33964030b0fb776689b02f200da5c134f7fa2719db1a0ea621ae94f2b2 WatchSource:0}: Error finding container e2545b33964030b0fb776689b02f200da5c134f7fa2719db1a0ea621ae94f2b2: Status 404 returned error can't find the container with id e2545b33964030b0fb776689b02f200da5c134f7fa2719db1a0ea621ae94f2b2 Jul 17 13:18:53.161741 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.161711 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92392aee_1962_4a2a_9e4e_c08db14444df.slice/crio-ec69b4150d519281375b3bff1c9f4e0520af5efe0d95b614238eeb2bb4432813 WatchSource:0}: Error finding container ec69b4150d519281375b3bff1c9f4e0520af5efe0d95b614238eeb2bb4432813: Status 404 returned error can't find the container with id ec69b4150d519281375b3bff1c9f4e0520af5efe0d95b614238eeb2bb4432813 Jul 17 13:18:53.163730 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.163710 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stwzb" Jul 17 13:18:53.172769 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.172747 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pgkwb" Jul 17 13:18:53.174567 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.174544 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84451f7e_4e57_4d73_8886_4ab6ae55c489.slice/crio-b0f154f4698122b60c69165be59eb62651493ad7d7d2f96154a88bf294920412 WatchSource:0}: Error finding container b0f154f4698122b60c69165be59eb62651493ad7d7d2f96154a88bf294920412: Status 404 returned error can't find the container with id b0f154f4698122b60c69165be59eb62651493ad7d7d2f96154a88bf294920412 Jul 17 13:18:53.180777 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.180752 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:18:53.182427 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.182398 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0793a5_bee4_49aa_a461_97a58a7d5fc6.slice/crio-ba19aac9af742fe85ce37f34c55f96194536aa8f0737140078a94e5230d41262 WatchSource:0}: Error finding container ba19aac9af742fe85ce37f34c55f96194536aa8f0737140078a94e5230d41262: Status 404 returned error can't find the container with id ba19aac9af742fe85ce37f34c55f96194536aa8f0737140078a94e5230d41262 Jul 17 13:18:53.188902 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.188882 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-99w2m" Jul 17 13:18:53.190656 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.190621 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee56a7e_cf4e_4223_9840_f1799df0d9ac.slice/crio-ef97da3af4d65f2e340d1c45e1c875ae7df1a74dee2d189df4f4842439b6f6a0 WatchSource:0}: Error finding container ef97da3af4d65f2e340d1c45e1c875ae7df1a74dee2d189df4f4842439b6f6a0: Status 404 returned error can't find the container with id ef97da3af4d65f2e340d1c45e1c875ae7df1a74dee2d189df4f4842439b6f6a0 Jul 17 13:18:53.193911 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.193890 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:18:53.200891 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.200871 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb877da_9edc_4334_bf13_cf3baff2516f.slice/crio-519353f9f9f00c113bf2b6ddc5dc553035e984731b94f223652bdf8ad02eab6b WatchSource:0}: Error finding container 519353f9f9f00c113bf2b6ddc5dc553035e984731b94f223652bdf8ad02eab6b: Status 404 returned error can't find the container with id 519353f9f9f00c113bf2b6ddc5dc553035e984731b94f223652bdf8ad02eab6b Jul 17 13:18:53.204710 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:18:53.204661 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa553e18_e0f0_4b20_928c_5b5418df0331.slice/crio-dd9b0f948890f18553b63977013068eb8029750a435bc15224eee96f0d0e5408 WatchSource:0}: Error finding container dd9b0f948890f18553b63977013068eb8029750a435bc15224eee96f0d0e5408: Status 404 returned error can't find the container with id dd9b0f948890f18553b63977013068eb8029750a435bc15224eee96f0d0e5408 Jul 17 13:18:53.205891 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.205868 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:18:53.564843 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.564754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:53.564843 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.564837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:53.565023 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.564951 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:53.565023 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.565003 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret podName:4c0ff472-2456-4cbb-a738-644225307091 nodeName:}" failed. No retries permitted until 2026-07-17 13:18:54.56498885 +0000 UTC m=+4.233524583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret") pod "global-pull-secret-syncer-vm9wl" (UID: "4c0ff472-2456-4cbb-a738-644225307091") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:53.565333 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.565306 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:53.565457 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.565387 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs podName:f8ca89ae-7469-4635-b5d0-01f124a55d7a nodeName:}" failed. No retries permitted until 2026-07-17 13:18:54.565366619 +0000 UTC m=+4.233902344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs") pod "network-metrics-daemon-wmxh4" (UID: "f8ca89ae-7469-4635-b5d0-01f124a55d7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:53.665158 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.665123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:53.665382 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.665363 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:18:53.665427 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.665387 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:18:53.665427 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.665398 2582 projected.go:196] Error preparing data for projected volume kube-api-access-fm4q6 for pod openshift-network-diagnostics/network-check-target-s62bj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:53.665496 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:53.665455 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6 podName:c3f212e0-b175-4de3-9f0e-fb1139d3afe0 nodeName:}" failed. No retries permitted until 2026-07-17 13:18:54.665439073 +0000 UTC m=+4.333974810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fm4q6" (UniqueName: "kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6") pod "network-check-target-s62bj" (UID: "c3f212e0-b175-4de3-9f0e-fb1139d3afe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:53.856816 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.856728 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:13:53 +0000 UTC" deadline="2028-01-29 10:32:13.132130214 +0000 UTC" Jul 17 13:18:53.856816 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.856764 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13461h13m19.275370505s" Jul 17 13:18:53.860814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.860774 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pgkwb" event={"ID":"8a0793a5-bee4-49aa-a461-97a58a7d5fc6","Type":"ContainerStarted","Data":"ba19aac9af742fe85ce37f34c55f96194536aa8f0737140078a94e5230d41262"} Jul 17 13:18:53.862236 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.862198 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stwzb" event={"ID":"84451f7e-4e57-4d73-8886-4ab6ae55c489","Type":"ContainerStarted","Data":"b0f154f4698122b60c69165be59eb62651493ad7d7d2f96154a88bf294920412"} Jul 17 13:18:53.863499 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.863462 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqwxv" event={"ID":"c3dc8168-45aa-40fe-a855-69ce3f723bf8","Type":"ContainerStarted","Data":"e2545b33964030b0fb776689b02f200da5c134f7fa2719db1a0ea621ae94f2b2"} Jul 17 13:18:53.864706 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.864677 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" event={"ID":"e341155b-9499-42cd-8171-d2b4a85435e3","Type":"ContainerStarted","Data":"8cab3c51d53892256f718a3bf3fd113ab85ada45eabb76b1683c217df8ec987a"} Jul 17 13:18:53.866159 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.866116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerStarted","Data":"2f07a2104692ac70b64fa5806862c01e39adc7269ef6580a7ffb7a0efe2f6ba9"} Jul 17 13:18:53.867535 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.867507 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8dwh9" event={"ID":"aa553e18-e0f0-4b20-928c-5b5418df0331","Type":"ContainerStarted","Data":"dd9b0f948890f18553b63977013068eb8029750a435bc15224eee96f0d0e5408"} Jul 17 13:18:53.868885 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.868850 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" event={"ID":"92392aee-1962-4a2a-9e4e-c08db14444df","Type":"ContainerStarted","Data":"ec69b4150d519281375b3bff1c9f4e0520af5efe0d95b614238eeb2bb4432813"} Jul 17 13:18:53.870047 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.870017 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-99w2m" event={"ID":"ebb877da-9edc-4334-bf13-cf3baff2516f","Type":"ContainerStarted","Data":"519353f9f9f00c113bf2b6ddc5dc553035e984731b94f223652bdf8ad02eab6b"} Jul 17 13:18:53.871300 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:53.871280 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"ef97da3af4d65f2e340d1c45e1c875ae7df1a74dee2d189df4f4842439b6f6a0"} Jul 17 13:18:54.571293 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.571238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:54.571488 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.571316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:54.571488 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.571469 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:54.571627 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.571528 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs podName:f8ca89ae-7469-4635-b5d0-01f124a55d7a nodeName:}" failed. No retries permitted until 2026-07-17 13:18:56.571513102 +0000 UTC m=+6.240048820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs") pod "network-metrics-daemon-wmxh4" (UID: "f8ca89ae-7469-4635-b5d0-01f124a55d7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:54.571877 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.571859 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:54.571931 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.571903 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret podName:4c0ff472-2456-4cbb-a738-644225307091 nodeName:}" failed. No retries permitted until 2026-07-17 13:18:56.57189231 +0000 UTC m=+6.240428028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret") pod "global-pull-secret-syncer-vm9wl" (UID: "4c0ff472-2456-4cbb-a738-644225307091") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:54.672819 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.672419 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:54.672819 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.672654 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:18:54.672819 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.672677 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:18:54.672819 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.672691 2582 projected.go:196] Error preparing data for projected volume kube-api-access-fm4q6 for pod openshift-network-diagnostics/network-check-target-s62bj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:54.672819 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.672755 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6 podName:c3f212e0-b175-4de3-9f0e-fb1139d3afe0 nodeName:}" failed. No retries permitted until 2026-07-17 13:18:56.672734297 +0000 UTC m=+6.341270017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fm4q6" (UniqueName: "kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6") pod "network-check-target-s62bj" (UID: "c3f212e0-b175-4de3-9f0e-fb1139d3afe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:54.845211 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.845129 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:54.845401 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.845277 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:18:54.845401 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.845326 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:54.845537 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.845474 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:18:54.845593 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.845521 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:54.845713 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:54.845669 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:18:54.863309 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.856928 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:13:53 +0000 UTC" deadline="2028-04-12 05:08:13.4119172 +0000 UTC" Jul 17 13:18:54.863309 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.856983 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15231h49m18.55493819s" Jul 17 13:18:54.879711 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.879435 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" event={"ID":"a444e4281a1962a7ac9260c67faa733a","Type":"ContainerStarted","Data":"b51d3aa5126680d7b6c7aee837f5301e7324049bf16ad0f647b06fde78854eb1"} Jul 17 13:18:54.895610 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:54.895544 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-223.ec2.internal" podStartSLOduration=2.895498765 podStartE2EDuration="2.895498765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:18:54.894947344 +0000 UTC m=+4.563483088" watchObservedRunningTime="2026-07-17 13:18:54.895498765 +0000 UTC m=+4.564034509" Jul 17 13:18:55.892903 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:55.892861 2582 generic.go:356] "Generic (PLEG): container finished" podID="ac1c64eb7fd1779affcc18145218f05a" containerID="a03e9dbc3132747e1db0a07be5d291561cd1f4d5f63976a0a1addf6ac6aa3639" exitCode=0 Jul 17 13:18:55.894851 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:55.893959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" event={"ID":"ac1c64eb7fd1779affcc18145218f05a","Type":"ContainerDied","Data":"a03e9dbc3132747e1db0a07be5d291561cd1f4d5f63976a0a1addf6ac6aa3639"} Jul 17 13:18:56.594780 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.594736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:56.594977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.594805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:56.595066 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.594989 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:56.595066 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.595058 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs podName:f8ca89ae-7469-4635-b5d0-01f124a55d7a nodeName:}" failed. No retries permitted until 2026-07-17 13:19:00.595034752 +0000 UTC m=+10.263570471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs") pod "network-metrics-daemon-wmxh4" (UID: "f8ca89ae-7469-4635-b5d0-01f124a55d7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:18:56.595528 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.595504 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:56.595632 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.595579 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret podName:4c0ff472-2456-4cbb-a738-644225307091 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:00.595554363 +0000 UTC m=+10.264090086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret") pod "global-pull-secret-syncer-vm9wl" (UID: "4c0ff472-2456-4cbb-a738-644225307091") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:18:56.696103 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.695418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:56.696103 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.695624 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:18:56.696103 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.695645 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:18:56.696103 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.695659 2582 projected.go:196] Error preparing data for projected volume kube-api-access-fm4q6 for pod openshift-network-diagnostics/network-check-target-s62bj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:56.696103 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.695720 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6 podName:c3f212e0-b175-4de3-9f0e-fb1139d3afe0 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:00.69570158 +0000 UTC m=+10.364237315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fm4q6" (UniqueName: "kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6") pod "network-check-target-s62bj" (UID: "c3f212e0-b175-4de3-9f0e-fb1139d3afe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:18:56.845213 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.845091 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:56.845416 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.845249 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:18:56.845721 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.845698 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:56.845855 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.845833 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:18:56.845928 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.845903 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:56.845994 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:56.845976 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:18:56.901195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.901156 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" event={"ID":"ac1c64eb7fd1779affcc18145218f05a","Type":"ContainerStarted","Data":"71c06b1891b16777a3f17b49caaa00b0ab968023426ae187492dc95cfbc5e688"} Jul 17 13:18:56.917599 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:56.917536 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-223.ec2.internal" podStartSLOduration=4.917514378 podStartE2EDuration="4.917514378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:18:56.916499189 +0000 UTC m=+6.585034936" watchObservedRunningTime="2026-07-17 13:18:56.917514378 +0000 UTC m=+6.586050122" Jul 17 13:18:58.842438 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:58.842400 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:18:58.842883 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:58.842543 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:18:58.842994 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:58.842972 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:18:58.843119 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:58.843100 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:18:58.843199 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:18:58.843179 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:18:58.843316 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:18:58.843273 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:00.623786 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:00.623733 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:00.624268 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:00.623814 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:00.624268 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.623916 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:19:00.624268 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.623957 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:19:00.624268 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.623992 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret podName:4c0ff472-2456-4cbb-a738-644225307091 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:08.623971092 +0000 UTC m=+18.292506834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret") pod "global-pull-secret-syncer-vm9wl" (UID: "4c0ff472-2456-4cbb-a738-644225307091") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:19:00.624268 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.624013 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs podName:f8ca89ae-7469-4635-b5d0-01f124a55d7a nodeName:}" failed. No retries permitted until 2026-07-17 13:19:08.624002156 +0000 UTC m=+18.292537874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs") pod "network-metrics-daemon-wmxh4" (UID: "f8ca89ae-7469-4635-b5d0-01f124a55d7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:19:00.724868 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:00.724832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:00.725069 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.725021 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:19:00.725069 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.725047 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:19:00.725069 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.725060 2582 projected.go:196] Error preparing data for projected volume kube-api-access-fm4q6 for pod openshift-network-diagnostics/network-check-target-s62bj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:19:00.725269 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.725128 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6 podName:c3f212e0-b175-4de3-9f0e-fb1139d3afe0 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:08.725108809 +0000 UTC m=+18.393644542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fm4q6" (UniqueName: "kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6") pod "network-check-target-s62bj" (UID: "c3f212e0-b175-4de3-9f0e-fb1139d3afe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:19:00.844208 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:00.844168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:00.844365 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.844294 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:00.844905 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:00.844656 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:00.844905 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.844755 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:00.844905 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:00.844808 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:00.844905 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:00.844871 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:02.843252 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:02.842449 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:02.843252 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:02.842449 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:02.843252 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:02.842608 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:02.843252 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:02.842454 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:02.843252 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:02.842652 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:02.843252 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:02.842717 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:04.843213 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:04.843116 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:04.843676 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:04.843126 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:04.843676 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:04.843269 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:04.843676 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:04.843265 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:04.843676 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:04.843376 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:04.843676 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:04.843459 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:06.842846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:06.842817 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:06.842846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:06.842846 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:06.843392 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:06.842821 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:06.843392 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:06.842943 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:06.843392 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:06.843031 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:06.843392 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:06.843130 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:08.685482 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:08.685448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:08.685482 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:08.685495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:08.686053 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.685612 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:19:08.686053 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.685623 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:19:08.686053 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.685677 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs podName:f8ca89ae-7469-4635-b5d0-01f124a55d7a nodeName:}" failed. No retries permitted until 2026-07-17 13:19:24.685655371 +0000 UTC m=+34.354191093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs") pod "network-metrics-daemon-wmxh4" (UID: "f8ca89ae-7469-4635-b5d0-01f124a55d7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:19:08.686053 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.685693 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret podName:4c0ff472-2456-4cbb-a738-644225307091 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:24.685686916 +0000 UTC m=+34.354222632 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret") pod "global-pull-secret-syncer-vm9wl" (UID: "4c0ff472-2456-4cbb-a738-644225307091") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:19:08.786506 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:08.786478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:08.786683 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.786610 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:19:08.786683 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.786631 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:19:08.786683 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.786643 2582 projected.go:196] Error preparing data for projected volume kube-api-access-fm4q6 for pod openshift-network-diagnostics/network-check-target-s62bj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:19:08.786813 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.786694 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6 podName:c3f212e0-b175-4de3-9f0e-fb1139d3afe0 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:24.786680903 +0000 UTC m=+34.455216637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fm4q6" (UniqueName: "kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6") pod "network-check-target-s62bj" (UID: "c3f212e0-b175-4de3-9f0e-fb1139d3afe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:19:08.842428 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:08.842397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:08.842591 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:08.842397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:08.842591 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.842517 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:08.842591 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.842564 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:08.842591 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:08.842397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:08.842753 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:08.842650 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:10.842955 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:10.842916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:10.843461 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:10.843017 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:10.843461 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:10.843070 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:10.843461 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:10.843215 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:10.843461 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:10.843266 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:10.843461 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:10.843338 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:12.847714 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:12.845326 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:12.847714 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:12.845443 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:12.847714 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:12.845809 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:12.847714 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:12.845913 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:12.847714 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:12.846593 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:12.847714 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:12.846671 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:12.935017 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:12.934988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8dwh9" event={"ID":"aa553e18-e0f0-4b20-928c-5b5418df0331","Type":"ContainerStarted","Data":"1bd032d765a80c2c0c9ea3603de9057c451eca2e50662ba194d29ff93616379e"} Jul 17 13:19:12.939371 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:12.939235 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" event={"ID":"92392aee-1962-4a2a-9e4e-c08db14444df","Type":"ContainerStarted","Data":"e661c0151ce89d0e0aacaa068c4ed01657e8bdb5e2b63e81ac4f497f486488a6"} Jul 17 13:19:12.950277 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:12.950227 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8dwh9" podStartSLOduration=10.614282526 podStartE2EDuration="21.950124408s" totalImagesPullingTime="11.335841882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:12.949257349 +0000 UTC m=+22.617793088" watchObservedRunningTime="2026-07-17 13:19:12.950124408 +0000 UTC m=+22.618660146" Jul 17 13:19:12.964657 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:12.964597 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fc4vm" podStartSLOduration=2.34992264 podStartE2EDuration="21.964581335s" totalImagesPullingTime="19.614658695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:12.964268844 +0000 UTC m=+22.632804583" watchObservedRunningTime="2026-07-17 13:19:12.964581335 +0000 UTC m=+22.633117075" Jul 17 13:19:13.943410 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.943130 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stwzb" event={"ID":"84451f7e-4e57-4d73-8886-4ab6ae55c489","Type":"ContainerStarted","Data":"9b56231274366f122a7ee528642ab897d67fa31fb9e9faf957ff931ced5a38e1"} Jul 17 13:19:13.944770 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.944737 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" event={"ID":"e341155b-9499-42cd-8171-d2b4a85435e3","Type":"ContainerStarted","Data":"f00aeadde33c784aeec559d37ed2802e4ef54a8d27d066293c131c9aac9a391d"} Jul 17 13:19:13.946463 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.946434 2582 generic.go:356] "Generic (PLEG): container finished" podID="1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be" containerID="6acc208eb4bc6b94b74f5321012412659f820a845a4a4dd077bcb4b4c24a92cc" exitCode=0 Jul 17 13:19:13.946603 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.946517 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerDied","Data":"6acc208eb4bc6b94b74f5321012412659f820a845a4a4dd077bcb4b4c24a92cc"} Jul 17 13:19:13.948199 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.948172 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-99w2m" event={"ID":"ebb877da-9edc-4334-bf13-cf3baff2516f","Type":"ContainerStarted","Data":"0feeeeadc8674e83607af559ee2e60b128ce32c661082b89129eb8bd085aeca2"} Jul 17 13:19:13.951116 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951099 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:19:13.951455 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951434 2582 generic.go:356] "Generic (PLEG): container finished" podID="0ee56a7e-cf4e-4223-9840-f1799df0d9ac" containerID="3d9d0b61142d3d4ec6d57d9bed3a6b5a6af8887f926553e52390ecbb979b6534" exitCode=1 Jul 17 13:19:13.951548 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951507 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"b04f983c20ce64136e113f811a8ef5c3d5fa157594add4ab7be4d2be8f5cc966"} Jul 17 13:19:13.951605 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951583 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"27bcb90c3a0507bb855c5c01f5ff7bdaec36a8b434aaaace34a494dc8c89d335"} Jul 17 13:19:13.951666 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951636 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"6ca121c50b2427c9d240678447c7d4302d22c45e90bab597eab2d8adfc068210"} Jul 17 13:19:13.951738 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"042495ecc3b2c2f86969a17ecf8ea40ff1c42299c0f722a4b46b35f7dc3762f9"} Jul 17 13:19:13.951800 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951734 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerDied","Data":"3d9d0b61142d3d4ec6d57d9bed3a6b5a6af8887f926553e52390ecbb979b6534"} Jul 17 13:19:13.951800 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.951794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"a326263e5749351ed045c8cdfdc170f26e6b2c278b5bf9f6ec888c89e99c4638"} Jul 17 13:19:13.953098 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.952922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pgkwb" event={"ID":"8a0793a5-bee4-49aa-a461-97a58a7d5fc6","Type":"ContainerStarted","Data":"591a6f1ba8dc46c2b5fc37702f4b39555f1eba8d6d2276a4b2afce289b992a97"} Jul 17 13:19:13.958521 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.958467 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-stwzb" podStartSLOduration=3.358173641 podStartE2EDuration="22.958450501s" totalImagesPullingTime="19.60027686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:13.957518329 +0000 UTC m=+23.626054068" watchObservedRunningTime="2026-07-17 13:19:13.958450501 +0000 UTC m=+23.626986241" Jul 17 13:19:13.990671 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:13.990626 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pgkwb" podStartSLOduration=11.632383091 podStartE2EDuration="22.9906109s" totalImagesPullingTime="11.358227809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:13.990282222 +0000 UTC m=+23.658817961" watchObservedRunningTime="2026-07-17 13:19:13.9906109 +0000 UTC m=+23.659146638" Jul 17 13:19:14.005930 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.005882 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-99w2m" podStartSLOduration=3.3807264 podStartE2EDuration="23.005869511s" totalImagesPullingTime="19.625143111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:14.005474829 +0000 UTC m=+23.674010559" watchObservedRunningTime="2026-07-17 13:19:14.005869511 +0000 UTC m=+23.674405249" Jul 17 13:19:14.541118 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.541094 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 13:19:14.843000 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.842926 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:14.843000 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.842942 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:14.843000 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.842942 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:14.843325 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:14.843041 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:14.843325 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:14.843092 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:14.843325 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:14.843207 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:14.854142 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.854052 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T13:19:14.541114033Z","UUID":"e6e36593-482b-483f-80aa-df13a2d1ecc9","Handler":null,"Name":"","Endpoint":""} Jul 17 13:19:14.855670 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.855654 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 13:19:14.855762 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.855692 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 13:19:14.957048 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.957006 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" event={"ID":"e341155b-9499-42cd-8171-d2b4a85435e3","Type":"ContainerStarted","Data":"eeed9b1a86b5aa161fb941316d11fa2c7b7aee650ee3d74aca6ceb7ab6711bd9"} Jul 17 13:19:14.958355 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.958327 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqwxv" event={"ID":"c3dc8168-45aa-40fe-a855-69ce3f723bf8","Type":"ContainerStarted","Data":"c72fd8498d64f80727153486f0b7804fce7162cc16bc4d48e03358c65f1c6587"} Jul 17 13:19:14.973542 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:14.973505 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cqwxv" podStartSLOduration=4.405221548 podStartE2EDuration="23.973494052s" totalImagesPullingTime="19.568272504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:14.973163846 +0000 UTC m=+24.641699575" watchObservedRunningTime="2026-07-17 13:19:14.973494052 +0000 UTC m=+24.642029791" Jul 17 13:19:15.079438 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:15.079403 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:19:15.965360 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:15.965331 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:19:15.965840 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:15.965774 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"86b20d4009e27a108beb136d84713c1dee6ffea488ded596feb52b441d3ab0eb"} Jul 17 13:19:16.782744 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.782449 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:19:16.783122 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.783100 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:19:16.842792 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.842754 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:16.842792 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.842773 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:16.843042 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:16.842878 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:16.843042 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:16.842952 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:16.843042 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.842966 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:16.843200 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:16.843065 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:16.970821 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.970785 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" event={"ID":"e341155b-9499-42cd-8171-d2b4a85435e3","Type":"ContainerStarted","Data":"46852d3f66e40f0c18e73fbc94ad9cbd707ed02e77c9c116d88e67fde5ca2f2e"} Jul 17 13:19:16.971705 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.971683 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8dwh9" Jul 17 13:19:16.999195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:16.999133 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qlt27" podStartSLOduration=3.192769319 podStartE2EDuration="25.999118872s" totalImagesPullingTime="22.806349553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:16.986483435 +0000 UTC m=+26.655019174" watchObservedRunningTime="2026-07-17 13:19:16.999118872 +0000 UTC m=+26.667654608" Jul 17 13:19:17.976216 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:17.976011 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:19:17.976926 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:17.976567 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"d09749f16fa95677d46a904c874cfaf78d7cbf4d7666c4f807b67d9f12ee47a9"} Jul 17 13:19:17.977164 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:17.977115 2582 scope.go:117] "RemoveContainer" containerID="3d9d0b61142d3d4ec6d57d9bed3a6b5a6af8887f926553e52390ecbb979b6534" Jul 17 13:19:18.843056 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.843026 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:18.843268 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.843028 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:18.843268 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.843159 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:18.843268 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:18.843177 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:18.843429 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:18.843267 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:18.843429 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:18.843359 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:18.984807 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.984777 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:19:18.985278 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.985248 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" event={"ID":"0ee56a7e-cf4e-4223-9840-f1799df0d9ac","Type":"ContainerStarted","Data":"62379cff60a2527810be2fc53a433e43adde912e6a6ee6a943937cea3e7b2c28"} Jul 17 13:19:18.985953 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.985701 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:19:18.985953 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.985787 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:19:18.985953 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:18.985837 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:19:19.002562 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.002457 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:19:19.003851 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.003827 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:19:19.009483 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.009431 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" podStartSLOduration=8.364171645 podStartE2EDuration="28.009411754s" totalImagesPullingTime="19.645240109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:19.007904771 +0000 UTC m=+28.676440511" watchObservedRunningTime="2026-07-17 13:19:19.009411754 +0000 UTC m=+28.677947489" Jul 17 13:19:19.656903 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.656818 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s62bj"] Jul 17 13:19:19.657057 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.656995 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:19.657166 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:19.657124 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:19.661208 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.661176 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm9wl"] Jul 17 13:19:19.661892 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.661372 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:19.661892 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:19.661479 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:19.661892 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.661801 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wmxh4"] Jul 17 13:19:19.662103 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:19.661908 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:19.662103 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:19.661998 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:20.843811 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:20.843781 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:20.844214 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:20.843878 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:20.844214 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:20.843901 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:20.844214 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:20.843980 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:20.991973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:20.991941 2582 generic.go:356] "Generic (PLEG): container finished" podID="1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be" containerID="b59b32f891bfe11528dc570265d09c0db4358a19d3e95580a0f47c8865d027e0" exitCode=0 Jul 17 13:19:20.992139 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:20.992028 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerDied","Data":"b59b32f891bfe11528dc570265d09c0db4358a19d3e95580a0f47c8865d027e0"} Jul 17 13:19:21.842529 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:21.842369 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:21.842631 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:21.842613 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:21.995711 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:21.995678 2582 generic.go:356] "Generic (PLEG): container finished" podID="1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be" containerID="f69bc7bc6fe99773e29188b227f19a8f228857621a53dab0d95e169c76611a79" exitCode=0 Jul 17 13:19:21.996052 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:21.995746 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerDied","Data":"f69bc7bc6fe99773e29188b227f19a8f228857621a53dab0d95e169c76611a79"} Jul 17 13:19:22.842262 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:22.842234 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:22.842262 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:22.842249 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:22.842483 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:22.842412 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:22.842483 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:22.842464 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:23.000091 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:23.000059 2582 generic.go:356] "Generic (PLEG): container finished" podID="1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be" containerID="b2961063dc87774725b213700a2dca0b4a18d187c70dbccbf2735484e2ad7000" exitCode=0 Jul 17 13:19:23.000861 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:23.000107 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerDied","Data":"b2961063dc87774725b213700a2dca0b4a18d187c70dbccbf2735484e2ad7000"} Jul 17 13:19:23.842328 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:23.842299 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:23.842471 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:23.842408 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9wl" podUID="4c0ff472-2456-4cbb-a738-644225307091" Jul 17 13:19:24.701405 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:24.701369 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:24.701936 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:24.701415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:24.701936 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.701539 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:19:24.701936 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.701563 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:19:24.701936 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.701610 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret podName:4c0ff472-2456-4cbb-a738-644225307091 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:56.701591443 +0000 UTC m=+66.370127159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret") pod "global-pull-secret-syncer-vm9wl" (UID: "4c0ff472-2456-4cbb-a738-644225307091") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:19:24.701936 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.701630 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs podName:f8ca89ae-7469-4635-b5d0-01f124a55d7a nodeName:}" failed. No retries permitted until 2026-07-17 13:19:56.701621208 +0000 UTC m=+66.370156929 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs") pod "network-metrics-daemon-wmxh4" (UID: "f8ca89ae-7469-4635-b5d0-01f124a55d7a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:19:24.802361 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:24.802329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:24.802503 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.802454 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:19:24.802503 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.802468 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:19:24.802503 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.802477 2582 projected.go:196] Error preparing data for projected volume kube-api-access-fm4q6 for pod openshift-network-diagnostics/network-check-target-s62bj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:19:24.802587 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.802524 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6 podName:c3f212e0-b175-4de3-9f0e-fb1139d3afe0 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:56.802511999 +0000 UTC m=+66.471047730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fm4q6" (UniqueName: "kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6") pod "network-check-target-s62bj" (UID: "c3f212e0-b175-4de3-9f0e-fb1139d3afe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:19:24.843159 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:24.843118 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:24.843300 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.843255 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wmxh4" podUID="f8ca89ae-7469-4635-b5d0-01f124a55d7a" Jul 17 13:19:24.843361 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:24.843330 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:24.843462 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:24.843439 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s62bj" podUID="c3f212e0-b175-4de3-9f0e-fb1139d3afe0" Jul 17 13:19:25.647789 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.647712 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-223.ec2.internal" event="NodeReady" Jul 17 13:19:25.647925 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.647846 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 13:19:25.678625 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.678590 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6dlvv"] Jul 17 13:19:25.683344 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.683234 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp"] Jul 17 13:19:25.684516 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.684488 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.686772 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.686752 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79c8d4d6b6-9n6w5"] Jul 17 13:19:25.686899 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.686878 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.687233 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.687125 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 13:19:25.687528 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.687489 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.688006 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.687721 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 13:19:25.688006 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.687858 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7wzpl\"" Jul 17 13:19:25.688006 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.687908 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.689074 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.689049 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 13:19:25.689397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.689376 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 13:19:25.689488 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.689436 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.690240 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.690220 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.690420 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.690400 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h"] Jul 17 13:19:25.690530 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.690513 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.690591 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.690398 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gttsr\"" Jul 17 13:19:25.692750 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.692729 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 13:19:25.692873 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.692776 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rnvr\"" Jul 17 13:19:25.693089 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.693054 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 13:19:25.693200 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.693114 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 13:19:25.693532 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.693511 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 13:19:25.694241 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.694216 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht"] Jul 17 13:19:25.694342 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.694326 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.697590 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.697332 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.697590 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.697367 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 13:19:25.697590 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.697455 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.697780 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.697686 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 13:19:25.697833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.697791 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tl5p4\"" Jul 17 13:19:25.698005 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.697966 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv"] Jul 17 13:19:25.698181 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.698046 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.703011 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.702475 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jbdbh\"" Jul 17 13:19:25.703011 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.702522 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xh8tg"] Jul 17 13:19:25.703011 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.702801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" Jul 17 13:19:25.703540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.703291 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 13:19:25.709253 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.709227 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c49788448-6b6gk"] Jul 17 13:19:25.709346 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.709256 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.709861 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.709842 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hcpkb\"" Jul 17 13:19:25.712086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.710376 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.712086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.710973 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.712086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.711592 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.712086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.711980 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 13:19:25.714852 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.714828 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.715423 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.715185 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 13:19:25.719360 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.719338 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.719797 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.719690 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl"] Jul 17 13:19:25.722397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.720012 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.722397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.720166 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8p99b\"" Jul 17 13:19:25.722397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.720452 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.722397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.720633 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 13:19:25.723126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.723104 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 13:19:25.723453 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.723409 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 13:19:25.723556 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.723513 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.723799 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.723647 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fxtnc\"" Jul 17 13:19:25.723799 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.723761 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 13:19:25.723909 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.723882 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.723980 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.723956 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 13:19:25.724126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.724105 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.724997 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6dlvv"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725052 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725077 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725098 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xh8tg"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725116 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725187 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725208 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c8d4d6b6-9n6w5"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725227 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xhh4d"] Jul 17 13:19:25.726041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.725437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:25.726574 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.726460 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 13:19:25.727755 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.727734 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 13:19:25.728018 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.728000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8pwr6\"" Jul 17 13:19:25.728127 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.728111 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.728127 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.728122 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.728460 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.728423 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89"] Jul 17 13:19:25.728555 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.728510 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:25.730313 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.730295 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.730478 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.730312 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 13:19:25.730631 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.730616 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rhkmk\"" Jul 17 13:19:25.730688 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.730650 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.732358 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.732113 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl"] Jul 17 13:19:25.732358 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.732183 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89"] Jul 17 13:19:25.732358 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.732207 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xhh4d"] Jul 17 13:19:25.732358 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.732227 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c49788448-6b6gk"] Jul 17 13:19:25.732358 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.732276 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" Jul 17 13:19:25.734285 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.734255 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 13:19:25.734442 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.734422 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 13:19:25.734642 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.734627 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f7lpk\"" Jul 17 13:19:25.788993 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.788973 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mvltr"] Jul 17 13:19:25.794720 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.794696 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:25.796826 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.796806 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 13:19:25.796914 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.796808 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 13:19:25.796968 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.796914 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdfvj\"" Jul 17 13:19:25.803137 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.803115 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mvltr"] Jul 17 13:19:25.809034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809015 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-registry-certificates\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.809123 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809040 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l5fx\" (UniqueName: \"kubernetes.io/projected/b3383f8a-6a4f-4a16-8b65-a146e512f812-kube-api-access-6l5fx\") pod \"network-check-source-7bc5b6bf85-w9h89\" (UID: \"b3383f8a-6a4f-4a16-8b65-a146e512f812\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" Jul 17 13:19:25.809123 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfzw\" (UniqueName: \"kubernetes.io/projected/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-kube-api-access-zkfzw\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:25.809123 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn45g\" (UniqueName: \"kubernetes.io/projected/e81918e8-0a9d-4880-88c3-8df0794e9b83-kube-api-access-mn45g\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.809123 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-trusted-ca\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mg4w\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-kube-api-access-4mg4w\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-297vz\" (UniqueName: \"kubernetes.io/projected/5d43d692-c2ac-4628-8a59-2b56a5302470-kube-api-access-297vz\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809227 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-default-certificate\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809243 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-stats-auth\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e81918e8-0a9d-4880-88c3-8df0794e9b83-config\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81918e8-0a9d-4880-88c3-8df0794e9b83-serving-cert\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-serving-cert\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.809302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-image-registry-private-configuration\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-tmp\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809370 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e81918e8-0a9d-4880-88c3-8df0794e9b83-trusted-ca\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809431 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-bound-sa-token\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809453 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5e6775-6604-4030-8396-ac3b91852cdb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-snapshots\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809505 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zljzj\" (UniqueName: \"kubernetes.io/projected/9ef98409-7867-4e27-afe1-3ecf63eb712a-kube-api-access-zljzj\") pod \"ingress-canary-xhh4d\" (UID: \"9ef98409-7867-4e27-afe1-3ecf63eb712a\") " pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:25.809540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae5e6775-6604-4030-8396-ac3b91852cdb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809553 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809573 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scklt\" (UniqueName: \"kubernetes.io/projected/ae5e6775-6604-4030-8396-ac3b91852cdb-kube-api-access-scklt\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809629 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ef98409-7867-4e27-afe1-3ecf63eb712a-cert\") pod \"ingress-canary-xhh4d\" (UID: \"9ef98409-7867-4e27-afe1-3ecf63eb712a\") " pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-config\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjs5d\" (UniqueName: \"kubernetes.io/projected/cb402625-b5b1-41db-91f2-82f6c16e7624-kube-api-access-wjs5d\") pod \"volume-data-source-validator-78cf4c6f6-qdpdv\" (UID: \"cb402625-b5b1-41db-91f2-82f6c16e7624\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d43d692-c2ac-4628-8a59-2b56a5302470-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.809761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809753 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs7l7\" (UniqueName: \"kubernetes.io/projected/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-kube-api-access-vs7l7\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.810026 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809781 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:25.810026 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809809 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-installation-pull-secrets\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.810026 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809836 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48b37390-35a0-47a3-b544-02e48b698820-ca-trust-extracted\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.810026 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809852 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-service-ca-bundle\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.810026 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809866 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566ws\" (UniqueName: \"kubernetes.io/projected/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-kube-api-access-566ws\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.810026 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.809886 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djkxj\" (UniqueName: \"kubernetes.io/projected/21fdc76d-8f78-499a-8b61-cbe8b58c0662-kube-api-access-djkxj\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.842266 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.842241 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:25.844178 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.844160 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:19:25.911126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn45g\" (UniqueName: \"kubernetes.io/projected/e81918e8-0a9d-4880-88c3-8df0794e9b83-kube-api-access-mn45g\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.911126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-trusted-ca\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.911126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911121 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mg4w\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-kube-api-access-4mg4w\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.911414 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911165 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.911414 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911195 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-297vz\" (UniqueName: \"kubernetes.io/projected/5d43d692-c2ac-4628-8a59-2b56a5302470-kube-api-access-297vz\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.911414 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911224 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:25.911414 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.911290 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:25.911414 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.911367 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls podName:5d43d692-c2ac-4628-8a59-2b56a5302470 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:26.411347223 +0000 UTC m=+36.079882953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b27ht" (UID: "5d43d692-c2ac-4628-8a59-2b56a5302470") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:25.911414 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-default-certificate\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.911414 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911411 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-stats-auth\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911431 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb7t5\" (UniqueName: \"kubernetes.io/projected/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-kube-api-access-kb7t5\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911454 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-tmp-dir\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e81918e8-0a9d-4880-88c3-8df0794e9b83-config\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911494 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81918e8-0a9d-4880-88c3-8df0794e9b83-serving-cert\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-serving-cert\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-image-registry-private-configuration\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911588 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-tmp\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911645 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e81918e8-0a9d-4880-88c3-8df0794e9b83-trusted-ca\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-bound-sa-token\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5e6775-6604-4030-8396-ac3b91852cdb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.911745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911733 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-snapshots\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zljzj\" (UniqueName: \"kubernetes.io/projected/9ef98409-7867-4e27-afe1-3ecf63eb712a-kube-api-access-zljzj\") pod \"ingress-canary-xhh4d\" (UID: \"9ef98409-7867-4e27-afe1-3ecf63eb712a\") " pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911786 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae5e6775-6604-4030-8396-ac3b91852cdb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911811 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scklt\" (UniqueName: \"kubernetes.io/projected/ae5e6775-6604-4030-8396-ac3b91852cdb-kube-api-access-scklt\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911902 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911923 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ef98409-7867-4e27-afe1-3ecf63eb712a-cert\") pod \"ingress-canary-xhh4d\" (UID: \"9ef98409-7867-4e27-afe1-3ecf63eb712a\") " pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-config\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.911968 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjs5d\" (UniqueName: \"kubernetes.io/projected/cb402625-b5b1-41db-91f2-82f6c16e7624-kube-api-access-wjs5d\") pod \"volume-data-source-validator-78cf4c6f6-qdpdv\" (UID: \"cb402625-b5b1-41db-91f2-82f6c16e7624\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912008 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d43d692-c2ac-4628-8a59-2b56a5302470-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912066 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs7l7\" (UniqueName: \"kubernetes.io/projected/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-kube-api-access-vs7l7\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-installation-pull-secrets\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.912316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48b37390-35a0-47a3-b544-02e48b698820-ca-trust-extracted\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912223 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-service-ca-bundle\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912250 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566ws\" (UniqueName: \"kubernetes.io/projected/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-kube-api-access-566ws\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djkxj\" (UniqueName: \"kubernetes.io/projected/21fdc76d-8f78-499a-8b61-cbe8b58c0662-kube-api-access-djkxj\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-config-volume\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912315 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-trusted-ca\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912346 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-registry-certificates\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l5fx\" (UniqueName: \"kubernetes.io/projected/b3383f8a-6a4f-4a16-8b65-a146e512f812-kube-api-access-6l5fx\") pod \"network-check-source-7bc5b6bf85-w9h89\" (UID: \"b3383f8a-6a4f-4a16-8b65-a146e512f812\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfzw\" (UniqueName: \"kubernetes.io/projected/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-kube-api-access-zkfzw\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912549 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-tmp\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.912656 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:26.412638964 +0000 UTC m=+36.081174695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : configmap references non-existent config key: service-ca.crt Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912678 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-config\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.912722 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e81918e8-0a9d-4880-88c3-8df0794e9b83-config\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.912755 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.912776 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c8d4d6b6-9n6w5: secret "image-registry-tls" not found Jul 17 13:19:25.912973 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.912833 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls podName:48b37390-35a0-47a3-b544-02e48b698820 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:26.412815943 +0000 UTC m=+36.081351674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls") pod "image-registry-79c8d4d6b6-9n6w5" (UID: "48b37390-35a0-47a3-b544-02e48b698820") : secret "image-registry-tls" not found Jul 17 13:19:25.913656 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.913319 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-service-ca-bundle\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.913656 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.913418 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e81918e8-0a9d-4880-88c3-8df0794e9b83-trusted-ca\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.913656 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.913546 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.914195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.914168 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-registry-certificates\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.915059 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.915032 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-snapshots\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.915576 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.915553 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae5e6775-6604-4030-8396-ac3b91852cdb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.916464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.916442 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-serving-cert\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.916578 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.916534 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-image-registry-private-configuration\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.917214 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.916755 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-stats-auth\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.917214 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.916846 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae5e6775-6604-4030-8396-ac3b91852cdb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.917214 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.916856 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:19:25.917214 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.916959 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls podName:9be16b4f-5ee9-4e1f-b450-5c219c3b10f9 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:26.416944784 +0000 UTC m=+36.085480527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5cfpl" (UID: "9be16b4f-5ee9-4e1f-b450-5c219c3b10f9") : secret "samples-operator-tls" not found Jul 17 13:19:25.917214 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.916908 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:19:25.917214 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:25.916997 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:26.416986953 +0000 UTC m=+36.085522693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : secret "router-metrics-certs-default" not found Jul 17 13:19:25.917214 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.917174 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48b37390-35a0-47a3-b544-02e48b698820-ca-trust-extracted\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.917625 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.917414 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-default-certificate\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.917625 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.917591 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d43d692-c2ac-4628-8a59-2b56a5302470-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.918216 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.918194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.918492 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.918471 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81918e8-0a9d-4880-88c3-8df0794e9b83-serving-cert\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.919216 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.919089 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ef98409-7867-4e27-afe1-3ecf63eb712a-cert\") pod \"ingress-canary-xhh4d\" (UID: \"9ef98409-7867-4e27-afe1-3ecf63eb712a\") " pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:25.920752 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.920547 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-installation-pull-secrets\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.920752 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.920609 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mg4w\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-kube-api-access-4mg4w\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.921669 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.920888 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn45g\" (UniqueName: \"kubernetes.io/projected/e81918e8-0a9d-4880-88c3-8df0794e9b83-kube-api-access-mn45g\") pod \"console-operator-565b7b569d-6dlvv\" (UID: \"e81918e8-0a9d-4880-88c3-8df0794e9b83\") " pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:25.921747 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.921675 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-297vz\" (UniqueName: \"kubernetes.io/projected/5d43d692-c2ac-4628-8a59-2b56a5302470-kube-api-access-297vz\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:25.922569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.922547 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-bound-sa-token\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:25.922715 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.922651 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfzw\" (UniqueName: \"kubernetes.io/projected/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-kube-api-access-zkfzw\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:25.923185 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.923132 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djkxj\" (UniqueName: \"kubernetes.io/projected/21fdc76d-8f78-499a-8b61-cbe8b58c0662-kube-api-access-djkxj\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:25.923725 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.923676 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zljzj\" (UniqueName: \"kubernetes.io/projected/9ef98409-7867-4e27-afe1-3ecf63eb712a-kube-api-access-zljzj\") pod \"ingress-canary-xhh4d\" (UID: \"9ef98409-7867-4e27-afe1-3ecf63eb712a\") " pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:25.924763 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.924742 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566ws\" (UniqueName: \"kubernetes.io/projected/e05af3b4-0faf-488f-b5ac-83799bb0f7b6-kube-api-access-566ws\") pod \"insights-operator-555d9d7885-xh8tg\" (UID: \"e05af3b4-0faf-488f-b5ac-83799bb0f7b6\") " pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:25.925666 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.925564 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs7l7\" (UniqueName: \"kubernetes.io/projected/6eeae02d-fa18-4f8e-b5de-b4e9d1098187-kube-api-access-vs7l7\") pod \"service-ca-operator-5bcbc94c78-4ht2h\" (UID: \"6eeae02d-fa18-4f8e-b5de-b4e9d1098187\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:25.925666 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.925577 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scklt\" (UniqueName: \"kubernetes.io/projected/ae5e6775-6604-4030-8396-ac3b91852cdb-kube-api-access-scklt\") pod \"kube-storage-version-migrator-operator-7658d9b749-mdnqp\" (UID: \"ae5e6775-6604-4030-8396-ac3b91852cdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:25.925771 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.925702 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjs5d\" (UniqueName: \"kubernetes.io/projected/cb402625-b5b1-41db-91f2-82f6c16e7624-kube-api-access-wjs5d\") pod \"volume-data-source-validator-78cf4c6f6-qdpdv\" (UID: \"cb402625-b5b1-41db-91f2-82f6c16e7624\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" Jul 17 13:19:25.926077 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:25.926056 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l5fx\" (UniqueName: \"kubernetes.io/projected/b3383f8a-6a4f-4a16-8b65-a146e512f812-kube-api-access-6l5fx\") pod \"network-check-source-7bc5b6bf85-w9h89\" (UID: \"b3383f8a-6a4f-4a16-8b65-a146e512f812\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" Jul 17 13:19:26.002746 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.002706 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:26.013008 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.012971 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-config-volume\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.013163 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.013028 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.013163 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.013048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7t5\" (UniqueName: \"kubernetes.io/projected/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-kube-api-access-kb7t5\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.013163 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.013065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-tmp-dir\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.013317 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.013188 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:19:26.013317 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.013256 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls podName:1f64b7fd-a0f7-4400-bda5-e0ab4c51454d nodeName:}" failed. No retries permitted until 2026-07-17 13:19:26.513237331 +0000 UTC m=+36.181773065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls") pod "dns-default-mvltr" (UID: "1f64b7fd-a0f7-4400-bda5-e0ab4c51454d") : secret "dns-default-metrics-tls" not found Jul 17 13:19:26.013649 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.013625 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-config-volume\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.013880 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.013861 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-tmp-dir\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.024479 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.024443 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb7t5\" (UniqueName: \"kubernetes.io/projected/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-kube-api-access-kb7t5\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.028520 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.028304 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" Jul 17 13:19:26.035566 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.035534 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" Jul 17 13:19:26.047775 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.047719 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" Jul 17 13:19:26.056045 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.056015 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xh8tg" Jul 17 13:19:26.076174 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.076130 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xhh4d" Jul 17 13:19:26.080253 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.080218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" Jul 17 13:19:26.250489 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.250419 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6dlvv"] Jul 17 13:19:26.254269 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:26.254227 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81918e8_0a9d_4880_88c3_8df0794e9b83.slice/crio-b33ee37b4556c2027b26d42495ea4d4ae62c5e9da6154be4b25e1bc9116dd224 WatchSource:0}: Error finding container b33ee37b4556c2027b26d42495ea4d4ae62c5e9da6154be4b25e1bc9116dd224: Status 404 returned error can't find the container with id b33ee37b4556c2027b26d42495ea4d4ae62c5e9da6154be4b25e1bc9116dd224 Jul 17 13:19:26.264561 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.264491 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp"] Jul 17 13:19:26.276091 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:26.276064 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5e6775_6604_4030_8396_ac3b91852cdb.slice/crio-498b093de0c4844db66b51be5ba152f79131ebaa059ee4646e7484f1e72c1266 WatchSource:0}: Error finding container 498b093de0c4844db66b51be5ba152f79131ebaa059ee4646e7484f1e72c1266: Status 404 returned error can't find the container with id 498b093de0c4844db66b51be5ba152f79131ebaa059ee4646e7484f1e72c1266 Jul 17 13:19:26.310387 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.310306 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h"] Jul 17 13:19:26.316632 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:26.316593 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eeae02d_fa18_4f8e_b5de_b4e9d1098187.slice/crio-8546c2b8a1e7a516a3276647eefd17a35fc1b51a7cda7f08b994675bfc51a2c0 WatchSource:0}: Error finding container 8546c2b8a1e7a516a3276647eefd17a35fc1b51a7cda7f08b994675bfc51a2c0: Status 404 returned error can't find the container with id 8546c2b8a1e7a516a3276647eefd17a35fc1b51a7cda7f08b994675bfc51a2c0 Jul 17 13:19:26.353172 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.353130 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89"] Jul 17 13:19:26.359338 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:26.359303 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3383f8a_6a4f_4a16_8b65_a146e512f812.slice/crio-2e5a6f1ca5abc1e799de71ac2d90573b0e573ef1f32e4b98be289e06c38ae3f2 WatchSource:0}: Error finding container 2e5a6f1ca5abc1e799de71ac2d90573b0e573ef1f32e4b98be289e06c38ae3f2: Status 404 returned error can't find the container with id 2e5a6f1ca5abc1e799de71ac2d90573b0e573ef1f32e4b98be289e06c38ae3f2 Jul 17 13:19:26.364523 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.364458 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv"] Jul 17 13:19:26.367905 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:26.367875 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb402625_b5b1_41db_91f2_82f6c16e7624.slice/crio-ab42c9557506909a8878252918bb71a7d1c483b44e94d815024887c79655551a WatchSource:0}: Error finding container ab42c9557506909a8878252918bb71a7d1c483b44e94d815024887c79655551a: Status 404 returned error can't find the container with id ab42c9557506909a8878252918bb71a7d1c483b44e94d815024887c79655551a Jul 17 13:19:26.388864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.388836 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xh8tg"] Jul 17 13:19:26.391622 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.391602 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xhh4d"] Jul 17 13:19:26.392674 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:26.392584 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05af3b4_0faf_488f_b5ac_83799bb0f7b6.slice/crio-e065576b591e91fbe53057b49ef23f8194e50d0febf2083d8da3cdcbc3803399 WatchSource:0}: Error finding container e065576b591e91fbe53057b49ef23f8194e50d0febf2083d8da3cdcbc3803399: Status 404 returned error can't find the container with id e065576b591e91fbe53057b49ef23f8194e50d0febf2083d8da3cdcbc3803399 Jul 17 13:19:26.394914 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:26.394890 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef98409_7867_4e27_afe1_3ecf63eb712a.slice/crio-bd9fd32bb2601205da3c1210df32ff10f7d10243cf3b216ca159cb860cad156d WatchSource:0}: Error finding container bd9fd32bb2601205da3c1210df32ff10f7d10243cf3b216ca159cb860cad156d: Status 404 returned error can't find the container with id bd9fd32bb2601205da3c1210df32ff10f7d10243cf3b216ca159cb860cad156d Jul 17 13:19:26.421707 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.421678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:26.421831 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.421755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:26.421831 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.421791 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421849 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421870 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c8d4d6b6-9n6w5: secret "image-registry-tls" not found Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421890 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421915 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421920 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls podName:48b37390-35a0-47a3-b544-02e48b698820 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:27.421900827 +0000 UTC m=+37.090436565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls") pod "image-registry-79c8d4d6b6-9n6w5" (UID: "48b37390-35a0-47a3-b544-02e48b698820") : secret "image-registry-tls" not found Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421951 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:27.421930453 +0000 UTC m=+37.090466185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : secret "router-metrics-certs-default" not found Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.421853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:26.421978 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421961 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:19:26.422296 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.421969 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls podName:5d43d692-c2ac-4628-8a59-2b56a5302470 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:27.421959417 +0000 UTC m=+37.090495134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b27ht" (UID: "5d43d692-c2ac-4628-8a59-2b56a5302470") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:26.422296 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.422043 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls podName:9be16b4f-5ee9-4e1f-b450-5c219c3b10f9 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:27.422016052 +0000 UTC m=+37.090551773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5cfpl" (UID: "9be16b4f-5ee9-4e1f-b450-5c219c3b10f9") : secret "samples-operator-tls" not found Jul 17 13:19:26.422296 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.422108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:26.422296 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.422240 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:27.422225044 +0000 UTC m=+37.090760773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : configmap references non-existent config key: service-ca.crt Jul 17 13:19:26.523190 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.523136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:26.523333 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.523278 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:19:26.523396 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:26.523336 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls podName:1f64b7fd-a0f7-4400-bda5-e0ab4c51454d nodeName:}" failed. No retries permitted until 2026-07-17 13:19:27.523320986 +0000 UTC m=+37.191856715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls") pod "dns-default-mvltr" (UID: "1f64b7fd-a0f7-4400-bda5-e0ab4c51454d") : secret "dns-default-metrics-tls" not found Jul 17 13:19:26.842295 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.842259 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:26.842746 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.842429 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:26.845571 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.845545 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:19:26.845571 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.845561 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p8qj\"" Jul 17 13:19:26.845571 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:26.845571 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7jn4x\"" Jul 17 13:19:27.011752 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.011691 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" event={"ID":"cb402625-b5b1-41db-91f2-82f6c16e7624","Type":"ContainerStarted","Data":"ab42c9557506909a8878252918bb71a7d1c483b44e94d815024887c79655551a"} Jul 17 13:19:27.012974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.012944 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xh8tg" event={"ID":"e05af3b4-0faf-488f-b5ac-83799bb0f7b6","Type":"ContainerStarted","Data":"e065576b591e91fbe53057b49ef23f8194e50d0febf2083d8da3cdcbc3803399"} Jul 17 13:19:27.014246 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.014211 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" event={"ID":"b3383f8a-6a4f-4a16-8b65-a146e512f812","Type":"ContainerStarted","Data":"2e5a6f1ca5abc1e799de71ac2d90573b0e573ef1f32e4b98be289e06c38ae3f2"} Jul 17 13:19:27.015520 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.015495 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" event={"ID":"6eeae02d-fa18-4f8e-b5de-b4e9d1098187","Type":"ContainerStarted","Data":"8546c2b8a1e7a516a3276647eefd17a35fc1b51a7cda7f08b994675bfc51a2c0"} Jul 17 13:19:27.016759 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.016729 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xhh4d" event={"ID":"9ef98409-7867-4e27-afe1-3ecf63eb712a","Type":"ContainerStarted","Data":"bd9fd32bb2601205da3c1210df32ff10f7d10243cf3b216ca159cb860cad156d"} Jul 17 13:19:27.017878 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.017857 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" event={"ID":"ae5e6775-6604-4030-8396-ac3b91852cdb","Type":"ContainerStarted","Data":"498b093de0c4844db66b51be5ba152f79131ebaa059ee4646e7484f1e72c1266"} Jul 17 13:19:27.018935 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.018914 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" event={"ID":"e81918e8-0a9d-4880-88c3-8df0794e9b83","Type":"ContainerStarted","Data":"b33ee37b4556c2027b26d42495ea4d4ae62c5e9da6154be4b25e1bc9116dd224"} Jul 17 13:19:27.433734 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.433694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:27.433913 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.433748 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:27.433913 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.433821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:27.433913 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.433869 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:19:27.434060 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.433939 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:19:27.434060 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.433872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:27.434060 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.433944 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:29.433924439 +0000 UTC m=+39.102460156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : secret "router-metrics-certs-default" not found Jul 17 13:19:27.434060 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.433998 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:27.434060 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.434009 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:29.433988801 +0000 UTC m=+39.102524519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : configmap references non-existent config key: service-ca.crt Jul 17 13:19:27.434060 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.434044 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls podName:9be16b4f-5ee9-4e1f-b450-5c219c3b10f9 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:29.434031947 +0000 UTC m=+39.102567670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5cfpl" (UID: "9be16b4f-5ee9-4e1f-b450-5c219c3b10f9") : secret "samples-operator-tls" not found Jul 17 13:19:27.434381 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.434066 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls podName:5d43d692-c2ac-4628-8a59-2b56a5302470 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:29.434052516 +0000 UTC m=+39.102588237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b27ht" (UID: "5d43d692-c2ac-4628-8a59-2b56a5302470") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:27.434381 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.434123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:27.434381 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.434211 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:19:27.434381 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.434226 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c8d4d6b6-9n6w5: secret "image-registry-tls" not found Jul 17 13:19:27.434381 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.434279 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls podName:48b37390-35a0-47a3-b544-02e48b698820 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:29.434264383 +0000 UTC m=+39.102800118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls") pod "image-registry-79c8d4d6b6-9n6w5" (UID: "48b37390-35a0-47a3-b544-02e48b698820") : secret "image-registry-tls" not found Jul 17 13:19:27.535009 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:27.534970 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:27.535205 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.535164 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:19:27.535260 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:27.535247 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls podName:1f64b7fd-a0f7-4400-bda5-e0ab4c51454d nodeName:}" failed. No retries permitted until 2026-07-17 13:19:29.535224229 +0000 UTC m=+39.203759948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls") pod "dns-default-mvltr" (UID: "1f64b7fd-a0f7-4400-bda5-e0ab4c51454d") : secret "dns-default-metrics-tls" not found Jul 17 13:19:29.032403 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.032124 2582 generic.go:356] "Generic (PLEG): container finished" podID="1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be" containerID="cb042aef760c813bb9673b213c53873992ad0c726e3dad2bea94cf6138150bad" exitCode=0 Jul 17 13:19:29.032982 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.032414 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerDied","Data":"cb042aef760c813bb9673b213c53873992ad0c726e3dad2bea94cf6138150bad"} Jul 17 13:19:29.456745 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.456659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:29.456897 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.456750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:29.456897 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.456783 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:29.456897 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.456863 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:29.457057 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.456912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:29.457108 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457067 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:33.457046198 +0000 UTC m=+43.125581920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : configmap references non-existent config key: service-ca.crt Jul 17 13:19:29.457559 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457539 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:19:29.457629 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457562 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c8d4d6b6-9n6w5: secret "image-registry-tls" not found Jul 17 13:19:29.457629 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457609 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls podName:48b37390-35a0-47a3-b544-02e48b698820 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:33.457593226 +0000 UTC m=+43.126128945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls") pod "image-registry-79c8d4d6b6-9n6w5" (UID: "48b37390-35a0-47a3-b544-02e48b698820") : secret "image-registry-tls" not found Jul 17 13:19:29.457741 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457667 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:19:29.457741 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457698 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:33.457688051 +0000 UTC m=+43.126223775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : secret "router-metrics-certs-default" not found Jul 17 13:19:29.457838 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457786 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:29.457889 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457855 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls podName:5d43d692-c2ac-4628-8a59-2b56a5302470 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:33.457812114 +0000 UTC m=+43.126347831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b27ht" (UID: "5d43d692-c2ac-4628-8a59-2b56a5302470") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:29.457943 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.457926 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:19:29.458094 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.458063 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls podName:9be16b4f-5ee9-4e1f-b450-5c219c3b10f9 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:33.458052894 +0000 UTC m=+43.126588614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5cfpl" (UID: "9be16b4f-5ee9-4e1f-b450-5c219c3b10f9") : secret "samples-operator-tls" not found Jul 17 13:19:29.558031 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:29.557941 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:29.558244 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.558192 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:19:29.558305 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:29.558258 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls podName:1f64b7fd-a0f7-4400-bda5-e0ab4c51454d nodeName:}" failed. No retries permitted until 2026-07-17 13:19:33.558239395 +0000 UTC m=+43.226775133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls") pod "dns-default-mvltr" (UID: "1f64b7fd-a0f7-4400-bda5-e0ab4c51454d") : secret "dns-default-metrics-tls" not found Jul 17 13:19:30.043785 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.042825 2582 generic.go:356] "Generic (PLEG): container finished" podID="1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be" containerID="bc48d389e2030dfc494d4cfe80ce2363cf9e60f44f016858b62aa1d233c757c6" exitCode=0 Jul 17 13:19:30.043785 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.042908 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerDied","Data":"bc48d389e2030dfc494d4cfe80ce2363cf9e60f44f016858b62aa1d233c757c6"} Jul 17 13:19:30.513328 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.513287 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl"] Jul 17 13:19:30.539234 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.538310 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl"] Jul 17 13:19:30.539234 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.538439 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:30.542054 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.540950 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 13:19:30.542054 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.541325 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b2qbp\"" Jul 17 13:19:30.545571 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.544977 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 13:19:30.670500 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.670467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9c29254-f182-4a01-9147-5dd4f8d0db7f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:30.670742 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.670715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:30.771960 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.771919 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:30.772159 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.772006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9c29254-f182-4a01-9147-5dd4f8d0db7f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:30.772159 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:30.772129 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:19:30.772280 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:30.772216 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert podName:b9c29254-f182-4a01-9147-5dd4f8d0db7f nodeName:}" failed. No retries permitted until 2026-07-17 13:19:31.272198014 +0000 UTC m=+40.940733744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-tbsxl" (UID: "b9c29254-f182-4a01-9147-5dd4f8d0db7f") : secret "networking-console-plugin-cert" not found Jul 17 13:19:30.773225 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:30.773204 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9c29254-f182-4a01-9147-5dd4f8d0db7f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:31.051798 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:31.051717 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzln6" event={"ID":"1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be","Type":"ContainerStarted","Data":"6e4265cc360d4eb70967004cb00ee9ac79d8ac4e7c240118fc6ea2f3166bb4c7"} Jul 17 13:19:31.053891 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:31.053856 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" event={"ID":"cb402625-b5b1-41db-91f2-82f6c16e7624","Type":"ContainerStarted","Data":"7f91d54aa7422a8a2865bfd30b83403ed1aea8513e45bbd4264f2fc2d522f8a7"} Jul 17 13:19:31.075610 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:31.075551 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vzln6" podStartSLOduration=6.828881751 podStartE2EDuration="40.075530805s" totalImagesPullingTime="33.246649054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:31.07347776 +0000 UTC m=+40.742013500" watchObservedRunningTime="2026-07-17 13:19:31.075530805 +0000 UTC m=+40.744066544" Jul 17 13:19:31.087623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:31.087554 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qdpdv" podStartSLOduration=23.18870416 podStartE2EDuration="27.087536844s" totalImagesPullingTime="3.898832684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:31.087381559 +0000 UTC m=+40.755917298" watchObservedRunningTime="2026-07-17 13:19:31.087536844 +0000 UTC m=+40.756072583" Jul 17 13:19:31.278407 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:31.278372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:31.278614 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:31.278584 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:19:31.278732 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:31.278683 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert podName:b9c29254-f182-4a01-9147-5dd4f8d0db7f nodeName:}" failed. No retries permitted until 2026-07-17 13:19:32.278658994 +0000 UTC m=+41.947194726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-tbsxl" (UID: "b9c29254-f182-4a01-9147-5dd4f8d0db7f") : secret "networking-console-plugin-cert" not found Jul 17 13:19:32.286528 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:32.286487 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:32.286989 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:32.286597 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:19:32.286989 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:32.286671 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert podName:b9c29254-f182-4a01-9147-5dd4f8d0db7f nodeName:}" failed. No retries permitted until 2026-07-17 13:19:34.286655001 +0000 UTC m=+43.955190732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-tbsxl" (UID: "b9c29254-f182-4a01-9147-5dd4f8d0db7f") : secret "networking-console-plugin-cert" not found Jul 17 13:19:33.497576 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:33.497535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:33.497604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:33.497694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497718 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.497700185 +0000 UTC m=+51.166235902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : configmap references non-existent config key: service-ca.crt Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:33.497764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497788 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497796 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497817 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c8d4d6b6-9n6w5: secret "image-registry-tls" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:33.497819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497840 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.497824258 +0000 UTC m=+51.166359991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : secret "router-metrics-certs-default" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497863 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls podName:48b37390-35a0-47a3-b544-02e48b698820 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.497852025 +0000 UTC m=+51.166387748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls") pod "image-registry-79c8d4d6b6-9n6w5" (UID: "48b37390-35a0-47a3-b544-02e48b698820") : secret "image-registry-tls" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497873 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497899 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls podName:5d43d692-c2ac-4628-8a59-2b56a5302470 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.497892137 +0000 UTC m=+51.166427853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b27ht" (UID: "5d43d692-c2ac-4628-8a59-2b56a5302470") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497925 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:19:33.498032 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.497975 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls podName:9be16b4f-5ee9-4e1f-b450-5c219c3b10f9 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.497962549 +0000 UTC m=+51.166498266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5cfpl" (UID: "9be16b4f-5ee9-4e1f-b450-5c219c3b10f9") : secret "samples-operator-tls" not found Jul 17 13:19:33.599127 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:33.599087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:33.599320 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.599274 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:19:33.599375 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:33.599366 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls podName:1f64b7fd-a0f7-4400-bda5-e0ab4c51454d nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.599345443 +0000 UTC m=+51.267881166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls") pod "dns-default-mvltr" (UID: "1f64b7fd-a0f7-4400-bda5-e0ab4c51454d") : secret "dns-default-metrics-tls" not found Jul 17 13:19:34.306397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:34.306356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:34.306565 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:34.306511 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:19:34.306607 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:34.306579 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert podName:b9c29254-f182-4a01-9147-5dd4f8d0db7f nodeName:}" failed. No retries permitted until 2026-07-17 13:19:38.306563532 +0000 UTC m=+47.975099262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-tbsxl" (UID: "b9c29254-f182-4a01-9147-5dd4f8d0db7f") : secret "networking-console-plugin-cert" not found Jul 17 13:19:37.080246 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.080204 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xh8tg" event={"ID":"e05af3b4-0faf-488f-b5ac-83799bb0f7b6","Type":"ContainerStarted","Data":"ae4bfd60dd3224a44416f7658a0bffb36beb13028a806766e7e2e7c615727c7a"} Jul 17 13:19:37.082183 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.082138 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" event={"ID":"b3383f8a-6a4f-4a16-8b65-a146e512f812","Type":"ContainerStarted","Data":"a2501353ec58abd527fa0aae9a94cd86291e99b1765de42d1fd7f11d293a21ed"} Jul 17 13:19:37.083712 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.083657 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" event={"ID":"6eeae02d-fa18-4f8e-b5de-b4e9d1098187","Type":"ContainerStarted","Data":"9bb6620e0bc52ee56c204d7ff4804f3007b6d47bc8150f2b3c13d47faa98150c"} Jul 17 13:19:37.085679 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.085649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xhh4d" event={"ID":"9ef98409-7867-4e27-afe1-3ecf63eb712a","Type":"ContainerStarted","Data":"4a1c098b6d569cf672650641ce968ed86fb7eea52caa8e6dac53534a00dfeee6"} Jul 17 13:19:37.087264 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.087237 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" event={"ID":"ae5e6775-6604-4030-8396-ac3b91852cdb","Type":"ContainerStarted","Data":"3f9d71b94880925a67e683da91337ecd2ae394cef270db0a3c7ebe040a3a2c40"} Jul 17 13:19:37.089455 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.089432 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/0.log" Jul 17 13:19:37.089584 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.089476 2582 generic.go:356] "Generic (PLEG): container finished" podID="e81918e8-0a9d-4880-88c3-8df0794e9b83" containerID="60f1e37bd04f22f33c426a9c37f9aee7a16f88c758a8ca48250f79d7625393dc" exitCode=255 Jul 17 13:19:37.089584 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.089516 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" event={"ID":"e81918e8-0a9d-4880-88c3-8df0794e9b83","Type":"ContainerDied","Data":"60f1e37bd04f22f33c426a9c37f9aee7a16f88c758a8ca48250f79d7625393dc"} Jul 17 13:19:37.089760 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.089741 2582 scope.go:117] "RemoveContainer" containerID="60f1e37bd04f22f33c426a9c37f9aee7a16f88c758a8ca48250f79d7625393dc" Jul 17 13:19:37.097266 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.097211 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-xh8tg" podStartSLOduration=23.394134806 podStartE2EDuration="33.097189662s" totalImagesPullingTime="9.703054856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:37.096644963 +0000 UTC m=+46.765180700" watchObservedRunningTime="2026-07-17 13:19:37.097189662 +0000 UTC m=+46.765725403" Jul 17 13:19:37.129112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.128274 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" podStartSLOduration=23.382335076 podStartE2EDuration="33.128253274s" totalImagesPullingTime="9.745918198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:37.112345095 +0000 UTC m=+46.780880816" watchObservedRunningTime="2026-07-17 13:19:37.128253274 +0000 UTC m=+46.796789011" Jul 17 13:19:37.142540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.142492 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" podStartSLOduration=23.327792794 podStartE2EDuration="33.142473797s" totalImagesPullingTime="9.814681003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:37.141208364 +0000 UTC m=+46.809744105" watchObservedRunningTime="2026-07-17 13:19:37.142473797 +0000 UTC m=+46.811009535" Jul 17 13:19:37.180429 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.179265 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w9h89" podStartSLOduration=23.432521541 podStartE2EDuration="33.179245013s" totalImagesPullingTime="9.746723472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:37.160983559 +0000 UTC m=+46.829519297" watchObservedRunningTime="2026-07-17 13:19:37.179245013 +0000 UTC m=+46.847780753" Jul 17 13:19:37.180429 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.180195 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xhh4d" podStartSLOduration=2.479042671 podStartE2EDuration="12.180181932s" totalImagesPullingTime="9.701139261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:19:37.178767403 +0000 UTC m=+46.847303133" watchObservedRunningTime="2026-07-17 13:19:37.180181932 +0000 UTC m=+46.848717676" Jul 17 13:19:37.735735 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.735699 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gjvfq"] Jul 17 13:19:37.780758 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.780726 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gjvfq"] Jul 17 13:19:37.780908 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.780845 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:37.783112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.783089 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 13:19:37.783255 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.783111 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 13:19:37.783255 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.783176 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p7mfr\"" Jul 17 13:19:37.945464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.945426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:37.945464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.945470 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-data-volume\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:37.945727 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.945497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-crio-socket\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:37.945727 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.945514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sktwx\" (UniqueName: \"kubernetes.io/projected/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-api-access-sktwx\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:37.945832 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:37.945734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.046326 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.046276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.046539 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.046372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.046539 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.046407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-data-volume\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.046539 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.046433 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:19:38.046539 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.046493 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:19:38.046539 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.046437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-crio-socket\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.046539 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.046503 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:38.546484188 +0000 UTC m=+48.215019904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : secret "insights-runtime-extractor-tls" not found Jul 17 13:19:38.046804 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.046585 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:38.546570956 +0000 UTC m=+48.215106680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : configmap "kube-rbac-proxy" not found Jul 17 13:19:38.046804 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.046611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sktwx\" (UniqueName: \"kubernetes.io/projected/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-api-access-sktwx\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.046804 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.046617 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-crio-socket\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.046804 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.046706 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-data-volume\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.056334 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.056305 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sktwx\" (UniqueName: \"kubernetes.io/projected/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-api-access-sktwx\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.094451 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.094420 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:19:38.094846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.094829 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/0.log" Jul 17 13:19:38.094919 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.094866 2582 generic.go:356] "Generic (PLEG): container finished" podID="e81918e8-0a9d-4880-88c3-8df0794e9b83" containerID="82c1d12f2d8e4d6b8135ea2f43b94d3e8cd9a51d9bf7644d3d876a095cc75209" exitCode=255 Jul 17 13:19:38.094987 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.094965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" event={"ID":"e81918e8-0a9d-4880-88c3-8df0794e9b83","Type":"ContainerDied","Data":"82c1d12f2d8e4d6b8135ea2f43b94d3e8cd9a51d9bf7644d3d876a095cc75209"} Jul 17 13:19:38.095046 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.095030 2582 scope.go:117] "RemoveContainer" containerID="60f1e37bd04f22f33c426a9c37f9aee7a16f88c758a8ca48250f79d7625393dc" Jul 17 13:19:38.095265 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.095245 2582 scope.go:117] "RemoveContainer" containerID="82c1d12f2d8e4d6b8135ea2f43b94d3e8cd9a51d9bf7644d3d876a095cc75209" Jul 17 13:19:38.095469 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.095438 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6dlvv_openshift-console-operator(e81918e8-0a9d-4880-88c3-8df0794e9b83)\"" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" podUID="e81918e8-0a9d-4880-88c3-8df0794e9b83" Jul 17 13:19:38.349485 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.349392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:38.349653 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.349534 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:19:38.349653 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.349591 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert podName:b9c29254-f182-4a01-9147-5dd4f8d0db7f nodeName:}" failed. No retries permitted until 2026-07-17 13:19:46.349576525 +0000 UTC m=+56.018112246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-tbsxl" (UID: "b9c29254-f182-4a01-9147-5dd4f8d0db7f") : secret "networking-console-plugin-cert" not found Jul 17 13:19:38.552106 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.552068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.552328 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:38.552134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:38.552328 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.552264 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:19:38.552328 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.552282 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:19:38.552480 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.552350 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:39.552329268 +0000 UTC m=+49.220865002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : secret "insights-runtime-extractor-tls" not found Jul 17 13:19:38.552480 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:38.552371 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:39.552362322 +0000 UTC m=+49.220898061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : configmap "kube-rbac-proxy" not found Jul 17 13:19:39.100361 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:39.100330 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:19:39.100756 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:39.100743 2582 scope.go:117] "RemoveContainer" containerID="82c1d12f2d8e4d6b8135ea2f43b94d3e8cd9a51d9bf7644d3d876a095cc75209" Jul 17 13:19:39.100956 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:39.100931 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6dlvv_openshift-console-operator(e81918e8-0a9d-4880-88c3-8df0794e9b83)\"" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" podUID="e81918e8-0a9d-4880-88c3-8df0794e9b83" Jul 17 13:19:39.563708 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:39.563663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:39.563916 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:39.563803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:39.563916 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:39.563807 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:19:39.563916 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:39.563890 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.563869024 +0000 UTC m=+51.232404759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : configmap "kube-rbac-proxy" not found Jul 17 13:19:39.563916 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:39.563896 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:19:39.564135 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:39.563939 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:41.563927189 +0000 UTC m=+51.232462922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : secret "insights-runtime-extractor-tls" not found Jul 17 13:19:40.329160 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:40.329111 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stwzb_84451f7e-4e57-4d73-8886-4ab6ae55c489/dns-node-resolver/0.log" Jul 17 13:19:40.928643 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:40.928615 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pgkwb_8a0793a5-bee4-49aa-a461-97a58a7d5fc6/node-ca/0.log" Jul 17 13:19:41.581055 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.581019 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.581169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581209 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581280 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls podName:9be16b4f-5ee9-4e1f-b450-5c219c3b10f9 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:57.581260743 +0000 UTC m=+67.249796482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5cfpl" (UID: "9be16b4f-5ee9-4e1f-b450-5c219c3b10f9") : secret "samples-operator-tls" not found Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.581214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581325 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581327 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.581362 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581381 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:45.581368671 +0000 UTC m=+55.249904402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : secret "insights-runtime-extractor-tls" not found Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581412 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls podName:5d43d692-c2ac-4628-8a59-2b56a5302470 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:57.581400536 +0000 UTC m=+67.249936259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-b27ht" (UID: "5d43d692-c2ac-4628-8a59-2b56a5302470") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581433 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:57.581423342 +0000 UTC m=+67.249959074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : configmap references non-existent config key: service-ca.crt Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.581475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:41.581527 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.581505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:41.581927 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.581563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:41.581927 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581655 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:19:41.581927 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581667 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:19:41.581927 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581669 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c8d4d6b6-9n6w5: secret "image-registry-tls" not found Jul 17 13:19:41.581927 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581717 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs podName:21fdc76d-8f78-499a-8b61-cbe8b58c0662 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:57.58170289 +0000 UTC m=+67.250238611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs") pod "router-default-c49788448-6b6gk" (UID: "21fdc76d-8f78-499a-8b61-cbe8b58c0662") : secret "router-metrics-certs-default" not found Jul 17 13:19:41.581927 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.581734 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls podName:48b37390-35a0-47a3-b544-02e48b698820 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:57.581727122 +0000 UTC m=+67.250262839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls") pod "image-registry-79c8d4d6b6-9n6w5" (UID: "48b37390-35a0-47a3-b544-02e48b698820") : secret "image-registry-tls" not found Jul 17 13:19:41.582113 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.582012 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:41.681966 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.681925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:41.682174 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.682093 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:19:41.682229 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:41.682182 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls podName:1f64b7fd-a0f7-4400-bda5-e0ab4c51454d nodeName:}" failed. No retries permitted until 2026-07-17 13:19:57.682162257 +0000 UTC m=+67.350697989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls") pod "dns-default-mvltr" (UID: "1f64b7fd-a0f7-4400-bda5-e0ab4c51454d") : secret "dns-default-metrics-tls" not found Jul 17 13:19:41.929311 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:41.929226 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xhh4d_9ef98409-7867-4e27-afe1-3ecf63eb712a/serve-healthcheck-canary/0.log" Jul 17 13:19:42.529140 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:42.529104 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-mdnqp_ae5e6775-6604-4030-8396-ac3b91852cdb/kube-storage-version-migrator-operator/0.log" Jul 17 13:19:45.614994 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:45.614951 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:45.615511 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:45.615114 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:19:45.615511 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:45.615213 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls podName:cd11e2ea-c0ff-4122-ae0c-a330c9f21a50 nodeName:}" failed. No retries permitted until 2026-07-17 13:19:53.615195676 +0000 UTC m=+63.283731393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjvfq" (UID: "cd11e2ea-c0ff-4122-ae0c-a330c9f21a50") : secret "insights-runtime-extractor-tls" not found Jul 17 13:19:46.003954 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:46.003861 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:46.003954 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:46.003921 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:19:46.004290 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:46.004277 2582 scope.go:117] "RemoveContainer" containerID="82c1d12f2d8e4d6b8135ea2f43b94d3e8cd9a51d9bf7644d3d876a095cc75209" Jul 17 13:19:46.004444 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:46.004426 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6dlvv_openshift-console-operator(e81918e8-0a9d-4880-88c3-8df0794e9b83)\"" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" podUID="e81918e8-0a9d-4880-88c3-8df0794e9b83" Jul 17 13:19:46.421024 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:46.420982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:19:46.421231 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:46.421125 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 13:19:46.421231 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:19:46.421218 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert podName:b9c29254-f182-4a01-9147-5dd4f8d0db7f nodeName:}" failed. No retries permitted until 2026-07-17 13:20:02.42120222 +0000 UTC m=+72.089737937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-tbsxl" (UID: "b9c29254-f182-4a01-9147-5dd4f8d0db7f") : secret "networking-console-plugin-cert" not found Jul 17 13:19:51.012050 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:51.012019 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2js58" Jul 17 13:19:53.681068 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:53.681022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:53.683335 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:53.683310 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd11e2ea-c0ff-4122-ae0c-a330c9f21a50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjvfq\" (UID: \"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50\") " pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:53.692574 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:53.692547 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p7mfr\"" Jul 17 13:19:53.700470 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:53.700447 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gjvfq" Jul 17 13:19:53.839424 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:53.839390 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gjvfq"] Jul 17 13:19:53.842840 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:53.842808 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd11e2ea_c0ff_4122_ae0c_a330c9f21a50.slice/crio-6df4fd0bc9dcd514d8ec9bd6d2ba469948863a333aa46180f34bd5b5e1049dab WatchSource:0}: Error finding container 6df4fd0bc9dcd514d8ec9bd6d2ba469948863a333aa46180f34bd5b5e1049dab: Status 404 returned error can't find the container with id 6df4fd0bc9dcd514d8ec9bd6d2ba469948863a333aa46180f34bd5b5e1049dab Jul 17 13:19:54.155092 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:54.155051 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjvfq" event={"ID":"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50","Type":"ContainerStarted","Data":"6df4fd0bc9dcd514d8ec9bd6d2ba469948863a333aa46180f34bd5b5e1049dab"} Jul 17 13:19:56.707291 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.707258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:56.707731 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.707414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:56.709570 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.709546 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:19:56.709693 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.709546 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:19:56.720833 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.720808 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c0ff472-2456-4cbb-a738-644225307091-original-pull-secret\") pod \"global-pull-secret-syncer-vm9wl\" (UID: \"4c0ff472-2456-4cbb-a738-644225307091\") " pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:56.720952 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.720831 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8ca89ae-7469-4635-b5d0-01f124a55d7a-metrics-certs\") pod \"network-metrics-daemon-wmxh4\" (UID: \"f8ca89ae-7469-4635-b5d0-01f124a55d7a\") " pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:56.750630 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.750603 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9wl" Jul 17 13:19:56.808457 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.808425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:56.811301 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.811274 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm4q6\" (UniqueName: \"kubernetes.io/projected/c3f212e0-b175-4de3-9f0e-fb1139d3afe0-kube-api-access-fm4q6\") pod \"network-check-target-s62bj\" (UID: \"c3f212e0-b175-4de3-9f0e-fb1139d3afe0\") " pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:56.858332 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.858300 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p8qj\"" Jul 17 13:19:56.863038 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.863016 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7jn4x\"" Jul 17 13:19:56.866853 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.866831 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wmxh4" Jul 17 13:19:56.871981 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:56.871964 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:19:57.617268 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.617229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:57.617445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.617296 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:57.617445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.617352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:57.617445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.617386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:57.617445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.617419 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:57.618170 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.618093 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21fdc76d-8f78-499a-8b61-cbe8b58c0662-service-ca-bundle\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:57.620301 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.620280 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"image-registry-79c8d4d6b6-9n6w5\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:57.620402 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.620368 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d43d692-c2ac-4628-8a59-2b56a5302470-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-b27ht\" (UID: \"5d43d692-c2ac-4628-8a59-2b56a5302470\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:57.620443 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.620423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9be16b4f-5ee9-4e1f-b450-5c219c3b10f9-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5cfpl\" (UID: \"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:57.620499 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.620479 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21fdc76d-8f78-499a-8b61-cbe8b58c0662-metrics-certs\") pod \"router-default-c49788448-6b6gk\" (UID: \"21fdc76d-8f78-499a-8b61-cbe8b58c0662\") " pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:57.718058 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.718016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:57.720591 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.720555 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f64b7fd-a0f7-4400-bda5-e0ab4c51454d-metrics-tls\") pod \"dns-default-mvltr\" (UID: \"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d\") " pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:57.819231 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.819200 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rnvr\"" Jul 17 13:19:57.827163 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.827127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:19:57.844600 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.844572 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jbdbh\"" Jul 17 13:19:57.853505 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.853478 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" Jul 17 13:19:57.864837 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.864811 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fxtnc\"" Jul 17 13:19:57.872340 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.872140 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8pwr6\"" Jul 17 13:19:57.873162 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.873126 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:19:57.880126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.880105 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" Jul 17 13:19:57.904846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.904809 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdfvj\"" Jul 17 13:19:57.913571 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:57.913538 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvltr" Jul 17 13:19:59.432636 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.431429 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wmxh4"] Jul 17 13:19:59.440853 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:59.440683 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ca89ae_7469_4635_b5d0_01f124a55d7a.slice/crio-ed6989c10a1cf66a3818b9e64d46cac4f0d0f802b07263e5fc4254f0d50084c2 WatchSource:0}: Error finding container ed6989c10a1cf66a3818b9e64d46cac4f0d0f802b07263e5fc4254f0d50084c2: Status 404 returned error can't find the container with id ed6989c10a1cf66a3818b9e64d46cac4f0d0f802b07263e5fc4254f0d50084c2 Jul 17 13:19:59.673494 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.673470 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm9wl"] Jul 17 13:19:59.676141 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.675972 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht"] Jul 17 13:19:59.676626 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:59.676598 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0ff472_2456_4cbb_a738_644225307091.slice/crio-c740bb32b220ebedf00e6442e60a43a8d80ce297cb9d8ae4d7f4e794870a39b0 WatchSource:0}: Error finding container c740bb32b220ebedf00e6442e60a43a8d80ce297cb9d8ae4d7f4e794870a39b0: Status 404 returned error can't find the container with id c740bb32b220ebedf00e6442e60a43a8d80ce297cb9d8ae4d7f4e794870a39b0 Jul 17 13:19:59.677107 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.677085 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s62bj"] Jul 17 13:19:59.678531 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:59.678482 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f212e0_b175_4de3_9f0e_fb1139d3afe0.slice/crio-a1f89f4b9fd2c00290683997764bd0495e48ee058fe1c8bf5963c0f757da8cfc WatchSource:0}: Error finding container a1f89f4b9fd2c00290683997764bd0495e48ee058fe1c8bf5963c0f757da8cfc: Status 404 returned error can't find the container with id a1f89f4b9fd2c00290683997764bd0495e48ee058fe1c8bf5963c0f757da8cfc Jul 17 13:19:59.679419 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:59.679392 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d43d692_c2ac_4628_8a59_2b56a5302470.slice/crio-d442c75ae634fcea3634db667bdcbe4746290aaa9fa80254a8c01e1673772512 WatchSource:0}: Error finding container d442c75ae634fcea3634db667bdcbe4746290aaa9fa80254a8c01e1673772512: Status 404 returned error can't find the container with id d442c75ae634fcea3634db667bdcbe4746290aaa9fa80254a8c01e1673772512 Jul 17 13:19:59.682860 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.682829 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c8d4d6b6-9n6w5"] Jul 17 13:19:59.685318 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.685292 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c49788448-6b6gk"] Jul 17 13:19:59.685425 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:59.685404 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b37390_35a0_47a3_b544_02e48b698820.slice/crio-18daeb88b56d2f81d0809727088203a3695815d700e25717a3ed8fc9eaae4b43 WatchSource:0}: Error finding container 18daeb88b56d2f81d0809727088203a3695815d700e25717a3ed8fc9eaae4b43: Status 404 returned error can't find the container with id 18daeb88b56d2f81d0809727088203a3695815d700e25717a3ed8fc9eaae4b43 Jul 17 13:19:59.690793 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:59.690760 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fdc76d_8f78_499a_8b61_cbe8b58c0662.slice/crio-c6a64e757f868cb989404d7081130c0f71750f5c70a3683c648fbbe1e2e45141 WatchSource:0}: Error finding container c6a64e757f868cb989404d7081130c0f71750f5c70a3683c648fbbe1e2e45141: Status 404 returned error can't find the container with id c6a64e757f868cb989404d7081130c0f71750f5c70a3683c648fbbe1e2e45141 Jul 17 13:19:59.732857 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.732827 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mvltr"] Jul 17 13:19:59.736353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.736238 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl"] Jul 17 13:19:59.736496 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:19:59.736454 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f64b7fd_a0f7_4400_bda5_e0ab4c51454d.slice/crio-123b7572e306a1d35372d261fe9fd2cf5794cbc5aa2cd36862ecd65921277727 WatchSource:0}: Error finding container 123b7572e306a1d35372d261fe9fd2cf5794cbc5aa2cd36862ecd65921277727: Status 404 returned error can't find the container with id 123b7572e306a1d35372d261fe9fd2cf5794cbc5aa2cd36862ecd65921277727 Jul 17 13:19:59.842886 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:19:59.842859 2582 scope.go:117] "RemoveContainer" containerID="82c1d12f2d8e4d6b8135ea2f43b94d3e8cd9a51d9bf7644d3d876a095cc75209" Jul 17 13:20:00.182464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.180005 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:20:00.182464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.180098 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" event={"ID":"e81918e8-0a9d-4880-88c3-8df0794e9b83","Type":"ContainerStarted","Data":"620c96be8bd1b5cf399987474c50d4cb22f91a67a3b701819fe34bbe716c6da7"} Jul 17 13:20:00.182464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.182397 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:20:00.195977 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.195887 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjvfq" event={"ID":"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50","Type":"ContainerStarted","Data":"af281e61604802bdba31237222e7fd7db20b0e74ef9e27c429a755a645e13727"} Jul 17 13:20:00.199068 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.197864 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" podStartSLOduration=46.358527529 podStartE2EDuration="56.197842757s" totalImagesPullingTime="9.839315228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:00.196888695 +0000 UTC m=+69.865424436" watchObservedRunningTime="2026-07-17 13:20:00.197842757 +0000 UTC m=+69.866378497" Jul 17 13:20:00.199904 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.199863 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" event={"ID":"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9","Type":"ContainerStarted","Data":"bdbecfb99d373d11c3f2592d5ade568ca03e099e60895f31d1708cc5729cb2db"} Jul 17 13:20:00.201770 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.201628 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" event={"ID":"5d43d692-c2ac-4628-8a59-2b56a5302470","Type":"ContainerStarted","Data":"d442c75ae634fcea3634db667bdcbe4746290aaa9fa80254a8c01e1673772512"} Jul 17 13:20:00.203022 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.202991 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvltr" event={"ID":"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d","Type":"ContainerStarted","Data":"123b7572e306a1d35372d261fe9fd2cf5794cbc5aa2cd36862ecd65921277727"} Jul 17 13:20:00.204817 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.204733 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wmxh4" event={"ID":"f8ca89ae-7469-4635-b5d0-01f124a55d7a","Type":"ContainerStarted","Data":"ed6989c10a1cf66a3818b9e64d46cac4f0d0f802b07263e5fc4254f0d50084c2"} Jul 17 13:20:00.207690 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.207054 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" event={"ID":"48b37390-35a0-47a3-b544-02e48b698820","Type":"ContainerStarted","Data":"eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017"} Jul 17 13:20:00.207690 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.207102 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" event={"ID":"48b37390-35a0-47a3-b544-02e48b698820","Type":"ContainerStarted","Data":"18daeb88b56d2f81d0809727088203a3695815d700e25717a3ed8fc9eaae4b43"} Jul 17 13:20:00.207890 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.207700 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:20:00.211296 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.211195 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c49788448-6b6gk" event={"ID":"21fdc76d-8f78-499a-8b61-cbe8b58c0662","Type":"ContainerStarted","Data":"7afe6a87ccf52b9967e1e529449f5f7eb9bf268ab052f78d09879c9b6ec6df95"} Jul 17 13:20:00.211534 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.211502 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c49788448-6b6gk" event={"ID":"21fdc76d-8f78-499a-8b61-cbe8b58c0662","Type":"ContainerStarted","Data":"c6a64e757f868cb989404d7081130c0f71750f5c70a3683c648fbbe1e2e45141"} Jul 17 13:20:00.213743 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.213702 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm9wl" event={"ID":"4c0ff472-2456-4cbb-a738-644225307091","Type":"ContainerStarted","Data":"c740bb32b220ebedf00e6442e60a43a8d80ce297cb9d8ae4d7f4e794870a39b0"} Jul 17 13:20:00.217558 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.217436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s62bj" event={"ID":"c3f212e0-b175-4de3-9f0e-fb1139d3afe0","Type":"ContainerStarted","Data":"00cd9e017f63ffefb4753cc305c2037fd480bac7fd5df97c0a43fc530acd380a"} Jul 17 13:20:00.217558 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.217493 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s62bj" event={"ID":"c3f212e0-b175-4de3-9f0e-fb1139d3afe0","Type":"ContainerStarted","Data":"a1f89f4b9fd2c00290683997764bd0495e48ee058fe1c8bf5963c0f757da8cfc"} Jul 17 13:20:00.218165 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.218133 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:20:00.226735 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.226677 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" podStartSLOduration=69.226656849 podStartE2EDuration="1m9.226656849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:00.226350887 +0000 UTC m=+69.894886629" watchObservedRunningTime="2026-07-17 13:20:00.226656849 +0000 UTC m=+69.895192587" Jul 17 13:20:00.244510 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.244450 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c49788448-6b6gk" podStartSLOduration=56.244426363 podStartE2EDuration="56.244426363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:00.242597031 +0000 UTC m=+69.911132771" watchObservedRunningTime="2026-07-17 13:20:00.244426363 +0000 UTC m=+69.912962104" Jul 17 13:20:00.257444 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.257388 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s62bj" podStartSLOduration=69.257368189 podStartE2EDuration="1m9.257368189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:00.256324256 +0000 UTC m=+69.924859993" watchObservedRunningTime="2026-07-17 13:20:00.257368189 +0000 UTC m=+69.925903912" Jul 17 13:20:00.873836 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.873803 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:20:00.876783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:00.876569 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:20:01.181691 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:01.181228 2582 patch_prober.go:28] interesting pod/console-operator-565b7b569d-6dlvv container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.6:8443/readyz\": context deadline exceeded" start-of-body= Jul 17 13:20:01.181691 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:01.181295 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" podUID="e81918e8-0a9d-4880-88c3-8df0794e9b83" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.6:8443/readyz\": context deadline exceeded" Jul 17 13:20:01.226892 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:01.226052 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:20:01.228101 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:01.227906 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c49788448-6b6gk" Jul 17 13:20:02.032418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.032347 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-6dlvv" Jul 17 13:20:02.231140 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.231098 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wmxh4" event={"ID":"f8ca89ae-7469-4635-b5d0-01f124a55d7a","Type":"ContainerStarted","Data":"e62f7a0512dbc283ca1b5a02aff24180e08e2deff2c5cd6b52a686c7f6f37344"} Jul 17 13:20:02.231341 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.231190 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wmxh4" event={"ID":"f8ca89ae-7469-4635-b5d0-01f124a55d7a","Type":"ContainerStarted","Data":"f1c69efba0314996cfdc7dd672a24a4963ef1062a2e9376bac5ae96b1525fa0c"} Jul 17 13:20:02.246593 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.246535 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wmxh4" podStartSLOduration=69.444673487 podStartE2EDuration="1m11.24651054s" totalImagesPullingTime="1.801837053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:02.245627102 +0000 UTC m=+71.914162843" watchObservedRunningTime="2026-07-17 13:20:02.24651054 +0000 UTC m=+71.915046280" Jul 17 13:20:02.475657 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.475561 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:20:02.478974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.478944 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9c29254-f182-4a01-9147-5dd4f8d0db7f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tbsxl\" (UID: \"b9c29254-f182-4a01-9147-5dd4f8d0db7f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:20:02.659234 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.659204 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b2qbp\"" Jul 17 13:20:02.667142 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.667112 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" Jul 17 13:20:02.714675 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.714642 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9"] Jul 17 13:20:02.718106 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.718081 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.721071 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.721046 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 13:20:02.721469 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.721451 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 13:20:02.721788 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.721734 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 13:20:02.721985 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.721965 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 13:20:02.730794 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.730769 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9"] Jul 17 13:20:02.778914 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.778874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6b9074b-ea9c-4623-888f-6067256f3841-klusterlet-config\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.779101 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.778934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7w4m\" (UniqueName: \"kubernetes.io/projected/a6b9074b-ea9c-4623-888f-6067256f3841-kube-api-access-j7w4m\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.779101 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.778978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b9074b-ea9c-4623-888f-6067256f3841-tmp\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.807040 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.807008 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-824ps"] Jul 17 13:20:02.810376 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.810353 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-824ps" Jul 17 13:20:02.813564 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.813396 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 13:20:02.813703 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.813659 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vqwj2\"" Jul 17 13:20:02.814803 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.814781 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 13:20:02.822048 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.821989 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-824ps"] Jul 17 13:20:02.879829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.879774 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/2d140957-1e08-4d8a-bbfb-8cdeaee9ae33-kube-api-access-8rt5j\") pod \"downloads-5bc67dcd46-824ps\" (UID: \"2d140957-1e08-4d8a-bbfb-8cdeaee9ae33\") " pod="openshift-console/downloads-5bc67dcd46-824ps" Jul 17 13:20:02.880012 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.879840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6b9074b-ea9c-4623-888f-6067256f3841-klusterlet-config\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.880080 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.880036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7w4m\" (UniqueName: \"kubernetes.io/projected/a6b9074b-ea9c-4623-888f-6067256f3841-kube-api-access-j7w4m\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.880080 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.880069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b9074b-ea9c-4623-888f-6067256f3841-tmp\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.880608 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.880559 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b9074b-ea9c-4623-888f-6067256f3841-tmp\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.883009 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.882982 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6b9074b-ea9c-4623-888f-6067256f3841-klusterlet-config\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.892337 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.892292 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7w4m\" (UniqueName: \"kubernetes.io/projected/a6b9074b-ea9c-4623-888f-6067256f3841-kube-api-access-j7w4m\") pod \"klusterlet-addon-workmgr-b66fcff45-t7vz9\" (UID: \"a6b9074b-ea9c-4623-888f-6067256f3841\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:02.980803 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:02.980707 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/2d140957-1e08-4d8a-bbfb-8cdeaee9ae33-kube-api-access-8rt5j\") pod \"downloads-5bc67dcd46-824ps\" (UID: \"2d140957-1e08-4d8a-bbfb-8cdeaee9ae33\") " pod="openshift-console/downloads-5bc67dcd46-824ps" Jul 17 13:20:03.001783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:03.001749 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rt5j\" (UniqueName: \"kubernetes.io/projected/2d140957-1e08-4d8a-bbfb-8cdeaee9ae33-kube-api-access-8rt5j\") pod \"downloads-5bc67dcd46-824ps\" (UID: \"2d140957-1e08-4d8a-bbfb-8cdeaee9ae33\") " pod="openshift-console/downloads-5bc67dcd46-824ps" Jul 17 13:20:03.034491 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:03.034252 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:03.123120 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:03.123081 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-824ps" Jul 17 13:20:07.537655 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:07.537315 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl"] Jul 17 13:20:07.598797 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:20:07.598751 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c29254_f182_4a01_9147_5dd4f8d0db7f.slice/crio-2223c8bf0fbf694df8f78d3c6014258d681207ab2cf15203483526cab6e8787a WatchSource:0}: Error finding container 2223c8bf0fbf694df8f78d3c6014258d681207ab2cf15203483526cab6e8787a: Status 404 returned error can't find the container with id 2223c8bf0fbf694df8f78d3c6014258d681207ab2cf15203483526cab6e8787a Jul 17 13:20:07.746782 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:07.746753 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-824ps"] Jul 17 13:20:07.749967 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:20:07.749932 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d140957_1e08_4d8a_bbfb_8cdeaee9ae33.slice/crio-06b403219c36cd58c1e9343ea9527f6d076b9f69faf0bc187eed766aae574cbd WatchSource:0}: Error finding container 06b403219c36cd58c1e9343ea9527f6d076b9f69faf0bc187eed766aae574cbd: Status 404 returned error can't find the container with id 06b403219c36cd58c1e9343ea9527f6d076b9f69faf0bc187eed766aae574cbd Jul 17 13:20:07.760782 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:07.760596 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9"] Jul 17 13:20:07.787526 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:20:07.787498 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b9074b_ea9c_4623_888f_6067256f3841.slice/crio-55f1987f1238fae9a4ab161f531d16a03d59a54493de13eac6d041418c4050d7 WatchSource:0}: Error finding container 55f1987f1238fae9a4ab161f531d16a03d59a54493de13eac6d041418c4050d7: Status 404 returned error can't find the container with id 55f1987f1238fae9a4ab161f531d16a03d59a54493de13eac6d041418c4050d7 Jul 17 13:20:08.260771 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.260685 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" event={"ID":"b9c29254-f182-4a01-9147-5dd4f8d0db7f","Type":"ContainerStarted","Data":"2223c8bf0fbf694df8f78d3c6014258d681207ab2cf15203483526cab6e8787a"} Jul 17 13:20:08.262511 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.262485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjvfq" event={"ID":"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50","Type":"ContainerStarted","Data":"522a05bf3c896566d54f88dd2aeb16270f3224d2b2398f3ead96dbd68e1f4458"} Jul 17 13:20:08.264113 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.264088 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" event={"ID":"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9","Type":"ContainerStarted","Data":"7622d8140ba442dd36b1f00199af11fa06cce3aec2f2f5ddd75acf89eab69cd3"} Jul 17 13:20:08.264226 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.264137 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" event={"ID":"9be16b4f-5ee9-4e1f-b450-5c219c3b10f9","Type":"ContainerStarted","Data":"6c97dd383c67a683a5ba72316aec44c900d42e9bfeb91d28ea7910383593a01b"} Jul 17 13:20:08.265808 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.265784 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" event={"ID":"5d43d692-c2ac-4628-8a59-2b56a5302470","Type":"ContainerStarted","Data":"ed15e5ad9f4c3cf0230d1b7e2306f63dd706b21de4fb76b37dd1911526a2573c"} Jul 17 13:20:08.269386 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.269364 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-824ps" event={"ID":"2d140957-1e08-4d8a-bbfb-8cdeaee9ae33","Type":"ContainerStarted","Data":"06b403219c36cd58c1e9343ea9527f6d076b9f69faf0bc187eed766aae574cbd"} Jul 17 13:20:08.270524 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.270504 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" event={"ID":"a6b9074b-ea9c-4623-888f-6067256f3841","Type":"ContainerStarted","Data":"55f1987f1238fae9a4ab161f531d16a03d59a54493de13eac6d041418c4050d7"} Jul 17 13:20:08.271981 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.271956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm9wl" event={"ID":"4c0ff472-2456-4cbb-a738-644225307091","Type":"ContainerStarted","Data":"6bc23de47837a71d8477cca783c6600a2fdedbc4caf2d2bed4c45a4b38b1a5dd"} Jul 17 13:20:08.273500 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.273483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvltr" event={"ID":"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d","Type":"ContainerStarted","Data":"15e0cae2073d723b0f7cf49e2bef5ac4c8cd4c93e680dd4d53248cd36060713d"} Jul 17 13:20:08.273586 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.273516 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvltr" event={"ID":"1f64b7fd-a0f7-4400-bda5-e0ab4c51454d","Type":"ContainerStarted","Data":"eef74917133b4dbf39583901799ca150cf4b1c3639a849e952917a1d1b35a37d"} Jul 17 13:20:08.273643 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.273625 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mvltr" Jul 17 13:20:08.282534 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.282495 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5cfpl" podStartSLOduration=56.460764447 podStartE2EDuration="1m4.282470218s" totalImagesPullingTime="7.821705771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:08.28100834 +0000 UTC m=+77.949544080" watchObservedRunningTime="2026-07-17 13:20:08.282470218 +0000 UTC m=+77.951006006" Jul 17 13:20:08.294493 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.294452 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vm9wl" podStartSLOduration=69.374190802 podStartE2EDuration="1m17.29443869s" totalImagesPullingTime="7.920247888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:08.293923967 +0000 UTC m=+77.962459706" watchObservedRunningTime="2026-07-17 13:20:08.29443869 +0000 UTC m=+77.962974406" Jul 17 13:20:08.311400 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.311364 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mvltr" podStartSLOduration=36.592708968 podStartE2EDuration="43.311351476s" totalImagesPullingTime="6.718642508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:08.310482094 +0000 UTC m=+77.979017835" watchObservedRunningTime="2026-07-17 13:20:08.311351476 +0000 UTC m=+77.979887215" Jul 17 13:20:08.325124 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:08.325068 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-b27ht" podStartSLOduration=57.549209339 podStartE2EDuration="1m4.325056259s" totalImagesPullingTime="6.77584692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:08.324898177 +0000 UTC m=+77.993433918" watchObservedRunningTime="2026-07-17 13:20:08.325056259 +0000 UTC m=+77.993591997" Jul 17 13:20:15.313313 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.312754 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" event={"ID":"b9c29254-f182-4a01-9147-5dd4f8d0db7f","Type":"ContainerStarted","Data":"d7a59154b3a1b17023eace69963486ab08956b6fe43f2a20ed9713ff95bdbeb3"} Jul 17 13:20:15.315481 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.315449 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjvfq" event={"ID":"cd11e2ea-c0ff-4122-ae0c-a330c9f21a50","Type":"ContainerStarted","Data":"9de4447337b0122b666d6beb46c98d0a46bc007c5b572afbd0f764f961610f2b"} Jul 17 13:20:15.317348 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.317323 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" event={"ID":"a6b9074b-ea9c-4623-888f-6067256f3841","Type":"ContainerStarted","Data":"20bfc6155137a89bb4a28075adeec926e779f2222f1d6feaec47bc11d8e7909f"} Jul 17 13:20:15.317557 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.317535 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:15.319471 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.319451 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" Jul 17 13:20:15.330046 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.329999 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tbsxl" podStartSLOduration=38.414794622 podStartE2EDuration="45.329985588s" totalImagesPullingTime="6.915190966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:15.32855701 +0000 UTC m=+84.997092750" watchObservedRunningTime="2026-07-17 13:20:15.329985588 +0000 UTC m=+84.998521363" Jul 17 13:20:15.374635 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.374520 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gjvfq" podStartSLOduration=17.907165176 podStartE2EDuration="38.374496012s" totalImagesPullingTime="20.467330836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:19:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:15.351488767 +0000 UTC m=+85.020024507" watchObservedRunningTime="2026-07-17 13:20:15.374496012 +0000 UTC m=+85.043031752" Jul 17 13:20:15.374950 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:15.374920 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b66fcff45-t7vz9" podStartSLOduration=6.618850009 podStartE2EDuration="13.374907088s" totalImagesPullingTime="6.756057079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:15.373621527 +0000 UTC m=+85.042157265" watchObservedRunningTime="2026-07-17 13:20:15.374907088 +0000 UTC m=+85.043442828" Jul 17 13:20:18.283554 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:18.283516 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mvltr" Jul 17 13:20:22.236823 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:22.236788 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:20:23.639852 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.639814 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9prth"] Jul 17 13:20:23.833487 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.833459 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.836753 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.836726 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 13:20:23.836753 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.836737 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 13:20:23.836967 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.836827 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5jhwq\"" Jul 17 13:20:23.836967 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.836876 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 13:20:23.836967 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.836956 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 13:20:23.972944 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.972864 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-tls\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.972944 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.972913 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-sys\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.973178 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.972948 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-root\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.973178 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.972977 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-wtmp\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.973178 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.973044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-metrics-client-ca\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.973178 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.973070 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-accelerators-collector-config\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.973178 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.973102 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.973432 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.973255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-textfile\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:23.973432 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:23.973312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhc5h\" (UniqueName: \"kubernetes.io/projected/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-kube-api-access-dhc5h\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074237 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074200 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhc5h\" (UniqueName: \"kubernetes.io/projected/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-kube-api-access-dhc5h\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074416 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074252 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-tls\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074416 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-sys\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074416 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-root\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074416 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-wtmp\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074416 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-metrics-client-ca\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074416 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074401 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-sys\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074409 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-root\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074434 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-accelerators-collector-config\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074481 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074520 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-wtmp\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.074697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.074529 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-textfile\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.075035 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.075007 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-metrics-client-ca\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.075216 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.075195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-accelerators-collector-config\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.075433 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.075369 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-textfile\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.077212 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.077194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.077361 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.077341 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-node-exporter-tls\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.082226 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.082208 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhc5h\" (UniqueName: \"kubernetes.io/projected/dc5584c2-49d0-4c19-9eb7-fd8dbc897127-kube-api-access-dhc5h\") pod \"node-exporter-9prth\" (UID: \"dc5584c2-49d0-4c19-9eb7-fd8dbc897127\") " pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.146364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.146330 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9prth" Jul 17 13:20:24.528759 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:24.528727 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79c8d4d6b6-9n6w5"] Jul 17 13:20:25.586320 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:20:25.586287 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5584c2_49d0_4c19_9eb7_fd8dbc897127.slice/crio-7ddbe228875479cc9697c71c68db2aa3cf3ffcc2c8b04cd5eff43dd1156b1c2b WatchSource:0}: Error finding container 7ddbe228875479cc9697c71c68db2aa3cf3ffcc2c8b04cd5eff43dd1156b1c2b: Status 404 returned error can't find the container with id 7ddbe228875479cc9697c71c68db2aa3cf3ffcc2c8b04cd5eff43dd1156b1c2b Jul 17 13:20:26.368528 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:26.368481 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-824ps" event={"ID":"2d140957-1e08-4d8a-bbfb-8cdeaee9ae33","Type":"ContainerStarted","Data":"3d5f1587cd462b1aafd9ffaa6cf725a947603ae289675521f17173bee7ec9c2e"} Jul 17 13:20:26.368769 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:26.368592 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-824ps" Jul 17 13:20:26.370291 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:26.370252 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9prth" event={"ID":"dc5584c2-49d0-4c19-9eb7-fd8dbc897127","Type":"ContainerStarted","Data":"7ddbe228875479cc9697c71c68db2aa3cf3ffcc2c8b04cd5eff43dd1156b1c2b"} Jul 17 13:20:26.381958 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:26.381930 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-824ps" Jul 17 13:20:26.384979 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:26.384922 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-824ps" podStartSLOduration=6.319216958 podStartE2EDuration="24.384910547s" totalImagesPullingTime="18.065693589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:26.38389978 +0000 UTC m=+96.052435522" watchObservedRunningTime="2026-07-17 13:20:26.384910547 +0000 UTC m=+96.053446285" Jul 17 13:20:27.378237 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:27.378191 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9prth" event={"ID":"dc5584c2-49d0-4c19-9eb7-fd8dbc897127","Type":"ContainerStarted","Data":"1e6524536cabf559d279907b1a8936082da13b6c6d9514a680e432d4cd0ded86"} Jul 17 13:20:28.386853 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:28.386815 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc5584c2-49d0-4c19-9eb7-fd8dbc897127" containerID="1e6524536cabf559d279907b1a8936082da13b6c6d9514a680e432d4cd0ded86" exitCode=0 Jul 17 13:20:28.387540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:28.387508 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9prth" event={"ID":"dc5584c2-49d0-4c19-9eb7-fd8dbc897127","Type":"ContainerDied","Data":"1e6524536cabf559d279907b1a8936082da13b6c6d9514a680e432d4cd0ded86"} Jul 17 13:20:29.394843 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:29.394807 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9prth" event={"ID":"dc5584c2-49d0-4c19-9eb7-fd8dbc897127","Type":"ContainerStarted","Data":"8dc7485c6a1bfb00b702115ef501503a743b04ccd32ab620e13f6334b3070c97"} Jul 17 13:20:29.395295 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:29.394866 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9prth" event={"ID":"dc5584c2-49d0-4c19-9eb7-fd8dbc897127","Type":"ContainerStarted","Data":"43851a3f90b0db4cb3c51a0334262020c76c90de9cbb87ef1e772d6548ddb1cf"} Jul 17 13:20:29.412656 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:29.412596 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9prth" podStartSLOduration=4.698966062 podStartE2EDuration="6.41257926s" totalImagesPullingTime="1.589736567s" totalInitContainerRuntime="123.876631ms" isStatefulPod=true podCreationTimestamp="2026-07-17 13:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:29.411350819 +0000 UTC m=+99.079886557" watchObservedRunningTime="2026-07-17 13:20:29.41257926 +0000 UTC m=+99.081115000" Jul 17 13:20:32.234647 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:32.234606 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s62bj" Jul 17 13:20:36.419126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.419093 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69db966db4-xjj6b"] Jul 17 13:20:36.534449 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.534418 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69db966db4-xjj6b"] Jul 17 13:20:36.534607 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.534513 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.537064 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.537040 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2xnbq\"" Jul 17 13:20:36.537222 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.537048 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 13:20:36.537797 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.537781 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 13:20:36.537849 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.537784 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 13:20:36.537849 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.537831 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 13:20:36.537936 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.537785 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 13:20:36.541766 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.541749 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 13:20:36.570691 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.570667 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-config\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.570814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.570696 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-trusted-ca-bundle\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.570814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.570737 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-oauth-serving-cert\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.570814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.570802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-serving-cert\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.570976 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.570834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-service-ca\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.570976 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.570867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-oauth-config\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.570976 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.570914 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccj68\" (UniqueName: \"kubernetes.io/projected/54e5e70c-2443-45b5-a7c0-dc3594753d6d-kube-api-access-ccj68\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.672212 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.672123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-oauth-serving-cert\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.672212 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.672204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-serving-cert\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.672444 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.672225 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-service-ca\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.672444 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.672249 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-oauth-config\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.672444 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.672288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj68\" (UniqueName: \"kubernetes.io/projected/54e5e70c-2443-45b5-a7c0-dc3594753d6d-kube-api-access-ccj68\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.672444 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.672324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-config\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.672444 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.672345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-trusted-ca-bundle\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.673029 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.673001 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-oauth-serving-cert\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.673136 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.673028 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-config\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.673136 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.673001 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-service-ca\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.673572 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.673551 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-trusted-ca-bundle\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.674789 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.674772 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-oauth-config\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.674982 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.674963 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-serving-cert\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.679378 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.679358 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccj68\" (UniqueName: \"kubernetes.io/projected/54e5e70c-2443-45b5-a7c0-dc3594753d6d-kube-api-access-ccj68\") pod \"console-69db966db4-xjj6b\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:36.843624 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:36.843591 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:37.009242 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:37.009210 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69db966db4-xjj6b"] Jul 17 13:20:37.012672 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:20:37.012636 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e5e70c_2443_45b5_a7c0_dc3594753d6d.slice/crio-f76262b1107651357978c4e597af9a0d57db48b273fab17135ccaa9d4fb95009 WatchSource:0}: Error finding container f76262b1107651357978c4e597af9a0d57db48b273fab17135ccaa9d4fb95009: Status 404 returned error can't find the container with id f76262b1107651357978c4e597af9a0d57db48b273fab17135ccaa9d4fb95009 Jul 17 13:20:37.435182 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:37.435130 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db966db4-xjj6b" event={"ID":"54e5e70c-2443-45b5-a7c0-dc3594753d6d","Type":"ContainerStarted","Data":"f76262b1107651357978c4e597af9a0d57db48b273fab17135ccaa9d4fb95009"} Jul 17 13:20:41.458947 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:41.458911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db966db4-xjj6b" event={"ID":"54e5e70c-2443-45b5-a7c0-dc3594753d6d","Type":"ContainerStarted","Data":"83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0"} Jul 17 13:20:41.476691 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:41.476631 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69db966db4-xjj6b" podStartSLOduration=1.989875322 podStartE2EDuration="5.476614408s" totalImagesPullingTime="3.486739086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:20:41.475669576 +0000 UTC m=+111.144205318" watchObservedRunningTime="2026-07-17 13:20:41.476614408 +0000 UTC m=+111.145150146" Jul 17 13:20:42.464589 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:42.464549 2582 generic.go:356] "Generic (PLEG): container finished" podID="e05af3b4-0faf-488f-b5ac-83799bb0f7b6" containerID="ae4bfd60dd3224a44416f7658a0bffb36beb13028a806766e7e2e7c615727c7a" exitCode=0 Jul 17 13:20:42.465103 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:42.464622 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xh8tg" event={"ID":"e05af3b4-0faf-488f-b5ac-83799bb0f7b6","Type":"ContainerDied","Data":"ae4bfd60dd3224a44416f7658a0bffb36beb13028a806766e7e2e7c615727c7a"} Jul 17 13:20:42.465103 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:42.464979 2582 scope.go:117] "RemoveContainer" containerID="ae4bfd60dd3224a44416f7658a0bffb36beb13028a806766e7e2e7c615727c7a" Jul 17 13:20:43.470288 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:43.470251 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xh8tg" event={"ID":"e05af3b4-0faf-488f-b5ac-83799bb0f7b6","Type":"ContainerStarted","Data":"1872bb8c0542d257075c923212a5e1de496f12fbd3fc250a5a95640c116d77a5"} Jul 17 13:20:46.848239 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:46.848204 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:46.848523 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:46.848264 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:46.849475 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:46.849449 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:47.488306 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:47.488268 2582 generic.go:356] "Generic (PLEG): container finished" podID="6eeae02d-fa18-4f8e-b5de-b4e9d1098187" containerID="9bb6620e0bc52ee56c204d7ff4804f3007b6d47bc8150f2b3c13d47faa98150c" exitCode=0 Jul 17 13:20:47.488505 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:47.488344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" event={"ID":"6eeae02d-fa18-4f8e-b5de-b4e9d1098187","Type":"ContainerDied","Data":"9bb6620e0bc52ee56c204d7ff4804f3007b6d47bc8150f2b3c13d47faa98150c"} Jul 17 13:20:47.488804 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:47.488778 2582 scope.go:117] "RemoveContainer" containerID="9bb6620e0bc52ee56c204d7ff4804f3007b6d47bc8150f2b3c13d47faa98150c" Jul 17 13:20:47.492250 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:47.492226 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:20:48.494489 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:48.494450 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4ht2h" event={"ID":"6eeae02d-fa18-4f8e-b5de-b4e9d1098187","Type":"ContainerStarted","Data":"53a812c9de0918c596576aa40f7ea48820262bc9dad34a2ff93bc56c2126aa78"} Jul 17 13:20:49.552908 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.552861 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" podUID="48b37390-35a0-47a3-b544-02e48b698820" containerName="registry" containerID="cri-o://eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017" gracePeriod=30 Jul 17 13:20:49.827003 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.826910 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:20:49.886012 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.885980 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-registry-certificates\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886012 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886018 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-installation-pull-secrets\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886047 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48b37390-35a0-47a3-b544-02e48b698820-ca-trust-extracted\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886065 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mg4w\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-kube-api-access-4mg4w\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886109 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-bound-sa-token\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886164 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-image-registry-private-configuration\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886192 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-trusted-ca\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886233 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") pod \"48b37390-35a0-47a3-b544-02e48b698820\" (UID: \"48b37390-35a0-47a3-b544-02e48b698820\") " Jul 17 13:20:49.886657 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886590 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:20:49.886775 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.886748 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:20:49.888981 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.888950 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:20:49.889106 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.889036 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-kube-api-access-4mg4w" (OuterVolumeSpecName: "kube-api-access-4mg4w") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "kube-api-access-4mg4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:20:49.889106 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.889061 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:20:49.889252 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.889186 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:20:49.889289 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.889266 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:20:49.894743 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.894720 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b37390-35a0-47a3-b544-02e48b698820-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "48b37390-35a0-47a3-b544-02e48b698820" (UID: "48b37390-35a0-47a3-b544-02e48b698820"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:20:49.987500 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987454 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-bound-sa-token\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:49.987500 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987495 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-image-registry-private-configuration\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:49.987500 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987508 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-trusted-ca\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:49.987762 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987520 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-registry-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:49.987762 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987531 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48b37390-35a0-47a3-b544-02e48b698820-registry-certificates\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:49.987762 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987544 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48b37390-35a0-47a3-b544-02e48b698820-installation-pull-secrets\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:49.987762 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987556 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48b37390-35a0-47a3-b544-02e48b698820-ca-trust-extracted\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:49.987762 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:49.987567 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mg4w\" (UniqueName: \"kubernetes.io/projected/48b37390-35a0-47a3-b544-02e48b698820-kube-api-access-4mg4w\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:20:50.502543 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.502504 2582 generic.go:356] "Generic (PLEG): container finished" podID="48b37390-35a0-47a3-b544-02e48b698820" containerID="eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017" exitCode=0 Jul 17 13:20:50.502732 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.502552 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" Jul 17 13:20:50.502732 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.502591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" event={"ID":"48b37390-35a0-47a3-b544-02e48b698820","Type":"ContainerDied","Data":"eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017"} Jul 17 13:20:50.502732 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.502641 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c8d4d6b6-9n6w5" event={"ID":"48b37390-35a0-47a3-b544-02e48b698820","Type":"ContainerDied","Data":"18daeb88b56d2f81d0809727088203a3695815d700e25717a3ed8fc9eaae4b43"} Jul 17 13:20:50.502732 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.502661 2582 scope.go:117] "RemoveContainer" containerID="eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017" Jul 17 13:20:50.512262 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.512242 2582 scope.go:117] "RemoveContainer" containerID="eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017" Jul 17 13:20:50.512556 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:20:50.512535 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017\": container with ID starting with eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017 not found: ID does not exist" containerID="eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017" Jul 17 13:20:50.512633 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.512565 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017"} err="failed to get container status \"eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017\": rpc error: code = NotFound desc = could not find container \"eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017\": container with ID starting with eefb05d40ca95755ba95b076b7ba29b86df11c98d0ff47624de0d6f84a155017 not found: ID does not exist" Jul 17 13:20:50.523553 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.523529 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79c8d4d6b6-9n6w5"] Jul 17 13:20:50.526922 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.526901 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79c8d4d6b6-9n6w5"] Jul 17 13:20:50.847283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:20:50.847243 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b37390-35a0-47a3-b544-02e48b698820" path="/var/lib/kubelet/pods/48b37390-35a0-47a3-b544-02e48b698820/volumes" Jul 17 13:21:02.547430 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:02.547392 2582 generic.go:356] "Generic (PLEG): container finished" podID="ae5e6775-6604-4030-8396-ac3b91852cdb" containerID="3f9d71b94880925a67e683da91337ecd2ae394cef270db0a3c7ebe040a3a2c40" exitCode=0 Jul 17 13:21:02.547430 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:02.547433 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" event={"ID":"ae5e6775-6604-4030-8396-ac3b91852cdb","Type":"ContainerDied","Data":"3f9d71b94880925a67e683da91337ecd2ae394cef270db0a3c7ebe040a3a2c40"} Jul 17 13:21:02.547871 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:02.547726 2582 scope.go:117] "RemoveContainer" containerID="3f9d71b94880925a67e683da91337ecd2ae394cef270db0a3c7ebe040a3a2c40" Jul 17 13:21:03.553298 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:03.553264 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mdnqp" event={"ID":"ae5e6775-6604-4030-8396-ac3b91852cdb","Type":"ContainerStarted","Data":"da4f2cc55bf7b54b34e050ed939d9f96ca58a6e6a3190d38ac34f227ec1eb627"} Jul 17 13:21:54.220570 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.220480 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9f489c6d-gw62p"] Jul 17 13:21:54.221348 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.221324 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b37390-35a0-47a3-b544-02e48b698820" containerName="registry" Jul 17 13:21:54.221348 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.221349 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b37390-35a0-47a3-b544-02e48b698820" containerName="registry" Jul 17 13:21:54.221507 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.221443 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b37390-35a0-47a3-b544-02e48b698820" containerName="registry" Jul 17 13:21:54.224555 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.224529 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.233543 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.233476 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f489c6d-gw62p"] Jul 17 13:21:54.307476 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.307418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-serving-cert\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.307682 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.307509 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-oauth-serving-cert\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.307682 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.307545 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjtmm\" (UniqueName: \"kubernetes.io/projected/7ca25be4-8121-4bc1-bbaf-9141a77d580f-kube-api-access-kjtmm\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.307682 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.307568 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-oauth-config\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.307682 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.307604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-config\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.307682 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.307634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-trusted-ca-bundle\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.307682 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.307676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-service-ca\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.408866 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.408825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-trusted-ca-bundle\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.408866 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.408872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-service-ca\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409082 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-serving-cert\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409119 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409098 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-oauth-serving-cert\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409198 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjtmm\" (UniqueName: \"kubernetes.io/projected/7ca25be4-8121-4bc1-bbaf-9141a77d580f-kube-api-access-kjtmm\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409247 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-oauth-config\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409296 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-config\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409681 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409651 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-service-ca\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409797 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409767 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-oauth-serving-cert\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409840 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409814 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-trusted-ca-bundle\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.409936 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.409919 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-config\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.411583 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.411563 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-oauth-config\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.411689 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.411672 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-serving-cert\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.417169 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.417129 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjtmm\" (UniqueName: \"kubernetes.io/projected/7ca25be4-8121-4bc1-bbaf-9141a77d580f-kube-api-access-kjtmm\") pod \"console-6f9f489c6d-gw62p\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.536318 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.536283 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:21:54.662949 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.662915 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9f489c6d-gw62p"] Jul 17 13:21:54.666222 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:21:54.666193 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca25be4_8121_4bc1_bbaf_9141a77d580f.slice/crio-97a7a95e0aca4b40d5739a3d622b1701bc6d9d419e38055fa7e84940033acd0a WatchSource:0}: Error finding container 97a7a95e0aca4b40d5739a3d622b1701bc6d9d419e38055fa7e84940033acd0a: Status 404 returned error can't find the container with id 97a7a95e0aca4b40d5739a3d622b1701bc6d9d419e38055fa7e84940033acd0a Jul 17 13:21:54.742007 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.741966 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f489c6d-gw62p" event={"ID":"7ca25be4-8121-4bc1-bbaf-9141a77d580f","Type":"ContainerStarted","Data":"9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30"} Jul 17 13:21:54.742215 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.742032 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f489c6d-gw62p" event={"ID":"7ca25be4-8121-4bc1-bbaf-9141a77d580f","Type":"ContainerStarted","Data":"97a7a95e0aca4b40d5739a3d622b1701bc6d9d419e38055fa7e84940033acd0a"} Jul 17 13:21:54.758250 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:21:54.758194 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9f489c6d-gw62p" podStartSLOduration=0.758175329 podStartE2EDuration="758.175329ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:21:54.757342386 +0000 UTC m=+184.425878125" watchObservedRunningTime="2026-07-17 13:21:54.758175329 +0000 UTC m=+184.426711070" Jul 17 13:22:04.537131 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:04.537088 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:22:04.537662 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:04.537177 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:22:04.542041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:04.542018 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:22:04.783777 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:04.783750 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:22:04.823970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:04.823890 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69db966db4-xjj6b"] Jul 17 13:22:29.847433 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:29.847381 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69db966db4-xjj6b" podUID="54e5e70c-2443-45b5-a7c0-dc3594753d6d" containerName="console" containerID="cri-o://83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0" gracePeriod=15 Jul 17 13:22:30.090618 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.090587 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:22:30.200783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.200705 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-trusted-ca-bundle\") pod \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " Jul 17 13:22:30.200783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.200744 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-oauth-config\") pod \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " Jul 17 13:22:30.200783 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.200772 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-service-ca\") pod \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " Jul 17 13:22:30.201051 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.200806 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-oauth-serving-cert\") pod \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " Jul 17 13:22:30.201051 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.200842 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-serving-cert\") pod \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " Jul 17 13:22:30.201051 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.200863 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccj68\" (UniqueName: \"kubernetes.io/projected/54e5e70c-2443-45b5-a7c0-dc3594753d6d-kube-api-access-ccj68\") pod \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " Jul 17 13:22:30.201051 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.200896 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-config\") pod \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\" (UID: \"54e5e70c-2443-45b5-a7c0-dc3594753d6d\") " Jul 17 13:22:30.201296 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.201252 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-service-ca" (OuterVolumeSpecName: "service-ca") pod "54e5e70c-2443-45b5-a7c0-dc3594753d6d" (UID: "54e5e70c-2443-45b5-a7c0-dc3594753d6d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:22:30.201411 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.201374 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "54e5e70c-2443-45b5-a7c0-dc3594753d6d" (UID: "54e5e70c-2443-45b5-a7c0-dc3594753d6d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:22:30.201411 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.201389 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "54e5e70c-2443-45b5-a7c0-dc3594753d6d" (UID: "54e5e70c-2443-45b5-a7c0-dc3594753d6d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:22:30.201504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.201488 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-config" (OuterVolumeSpecName: "console-config") pod "54e5e70c-2443-45b5-a7c0-dc3594753d6d" (UID: "54e5e70c-2443-45b5-a7c0-dc3594753d6d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:22:30.203466 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.203435 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "54e5e70c-2443-45b5-a7c0-dc3594753d6d" (UID: "54e5e70c-2443-45b5-a7c0-dc3594753d6d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:22:30.203466 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.203450 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "54e5e70c-2443-45b5-a7c0-dc3594753d6d" (UID: "54e5e70c-2443-45b5-a7c0-dc3594753d6d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:22:30.203640 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.203449 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54e5e70c-2443-45b5-a7c0-dc3594753d6d-kube-api-access-ccj68" (OuterVolumeSpecName: "kube-api-access-ccj68") pod "54e5e70c-2443-45b5-a7c0-dc3594753d6d" (UID: "54e5e70c-2443-45b5-a7c0-dc3594753d6d"). InnerVolumeSpecName "kube-api-access-ccj68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:22:30.301596 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.301563 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-trusted-ca-bundle\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:22:30.301596 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.301589 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-oauth-config\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:22:30.301596 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.301601 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-service-ca\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:22:30.301817 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.301610 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-oauth-serving-cert\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:22:30.301817 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.301622 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-serving-cert\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:22:30.301817 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.301631 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccj68\" (UniqueName: \"kubernetes.io/projected/54e5e70c-2443-45b5-a7c0-dc3594753d6d-kube-api-access-ccj68\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:22:30.301817 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.301642 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54e5e70c-2443-45b5-a7c0-dc3594753d6d-console-config\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:22:30.874441 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.874405 2582 generic.go:356] "Generic (PLEG): container finished" podID="54e5e70c-2443-45b5-a7c0-dc3594753d6d" containerID="83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0" exitCode=0 Jul 17 13:22:30.874848 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.874446 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db966db4-xjj6b" Jul 17 13:22:30.874848 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.874483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db966db4-xjj6b" event={"ID":"54e5e70c-2443-45b5-a7c0-dc3594753d6d","Type":"ContainerDied","Data":"83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0"} Jul 17 13:22:30.874848 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.874527 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db966db4-xjj6b" event={"ID":"54e5e70c-2443-45b5-a7c0-dc3594753d6d","Type":"ContainerDied","Data":"f76262b1107651357978c4e597af9a0d57db48b273fab17135ccaa9d4fb95009"} Jul 17 13:22:30.874848 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.874547 2582 scope.go:117] "RemoveContainer" containerID="83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0" Jul 17 13:22:30.882955 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.882932 2582 scope.go:117] "RemoveContainer" containerID="83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0" Jul 17 13:22:30.883232 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:22:30.883207 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0\": container with ID starting with 83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0 not found: ID does not exist" containerID="83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0" Jul 17 13:22:30.883303 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.883245 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0"} err="failed to get container status \"83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0\": rpc error: code = NotFound desc = could not find container \"83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0\": container with ID starting with 83ca54ee99a2e2bdd85a56d13221d4f0cccbd439fb26c430bc6dbb5110dc6cb0 not found: ID does not exist" Jul 17 13:22:30.889967 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.889942 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69db966db4-xjj6b"] Jul 17 13:22:30.893704 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:30.893683 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69db966db4-xjj6b"] Jul 17 13:22:32.848036 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:22:32.847999 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54e5e70c-2443-45b5-a7c0-dc3594753d6d" path="/var/lib/kubelet/pods/54e5e70c-2443-45b5-a7c0-dc3594753d6d/volumes" Jul 17 13:23:50.772102 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:50.772072 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:23:50.774838 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:50.774810 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:23:50.780991 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:50.780973 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 13:23:50.785651 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:50.785629 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:23:50.788519 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:50.788503 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:23:52.997782 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:52.997748 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs"] Jul 17 13:23:53.000079 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:52.998014 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e5e70c-2443-45b5-a7c0-dc3594753d6d" containerName="console" Jul 17 13:23:53.000079 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:52.998024 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e5e70c-2443-45b5-a7c0-dc3594753d6d" containerName="console" Jul 17 13:23:53.000079 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:52.998073 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e5e70c-2443-45b5-a7c0-dc3594753d6d" containerName="console" Jul 17 13:23:53.000964 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.000948 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:23:53.003332 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.003306 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 17 13:23:53.003332 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.003313 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 17 13:23:53.004219 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.004204 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-s8jwv\"" Jul 17 13:23:53.008941 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.008920 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs"] Jul 17 13:23:53.122691 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.122659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbk79\" (UniqueName: \"kubernetes.io/projected/6daa09eb-3cc2-4b26-acaa-1a7d8b065fed-kube-api-access-jbk79\") pod \"feast-operator-controller-manager-6c76bd89bc-mnhjs\" (UID: \"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed\") " pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:23:53.223426 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.223394 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbk79\" (UniqueName: \"kubernetes.io/projected/6daa09eb-3cc2-4b26-acaa-1a7d8b065fed-kube-api-access-jbk79\") pod \"feast-operator-controller-manager-6c76bd89bc-mnhjs\" (UID: \"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed\") " pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:23:53.231411 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.231384 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbk79\" (UniqueName: \"kubernetes.io/projected/6daa09eb-3cc2-4b26-acaa-1a7d8b065fed-kube-api-access-jbk79\") pod \"feast-operator-controller-manager-6c76bd89bc-mnhjs\" (UID: \"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed\") " pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:23:53.311289 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.311256 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:23:53.433961 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.433935 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs"] Jul 17 13:23:53.436332 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:23:53.436304 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6daa09eb_3cc2_4b26_acaa_1a7d8b065fed.slice/crio-d4e00b8389c849ca76edb407c2c871262c9ab9579f9f3a6117cd33fb971ed58a WatchSource:0}: Error finding container d4e00b8389c849ca76edb407c2c871262c9ab9579f9f3a6117cd33fb971ed58a: Status 404 returned error can't find the container with id d4e00b8389c849ca76edb407c2c871262c9ab9579f9f3a6117cd33fb971ed58a Jul 17 13:23:53.438262 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:53.438243 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:23:54.185022 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:54.184949 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" event={"ID":"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed","Type":"ContainerStarted","Data":"d4e00b8389c849ca76edb407c2c871262c9ab9579f9f3a6117cd33fb971ed58a"} Jul 17 13:23:56.194631 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:56.194589 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" event={"ID":"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed","Type":"ContainerStarted","Data":"034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde"} Jul 17 13:23:56.195061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:23:56.194681 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:24:07.201175 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:24:07.201129 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:24:07.217864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:24:07.217809 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" podStartSLOduration=12.947908563 podStartE2EDuration="15.217792439s" totalImagesPullingTime="2.269883876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:23:56.210895124 +0000 UTC m=+305.879430862" watchObservedRunningTime="2026-07-17 13:24:07.217792439 +0000 UTC m=+316.886328178" Jul 17 13:25:37.926642 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:37.926603 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d949b6f5f-hdf8w"] Jul 17 13:25:37.930464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:37.930440 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:37.940208 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:37.940178 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d949b6f5f-hdf8w"] Jul 17 13:25:38.042093 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.042043 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-config\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.042286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.042105 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-trusted-ca-bundle\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.042286 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.042209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgr86\" (UniqueName: \"kubernetes.io/projected/58128ae7-2139-43b4-bc9a-0b9d2165efcf-kube-api-access-hgr86\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.042360 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.042316 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-oauth-serving-cert\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.042397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.042362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-oauth-config\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.042397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.042383 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-serving-cert\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.042458 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.042398 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-service-ca\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.142942 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.142897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgr86\" (UniqueName: \"kubernetes.io/projected/58128ae7-2139-43b4-bc9a-0b9d2165efcf-kube-api-access-hgr86\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.143186 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.142969 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-oauth-serving-cert\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.143186 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.143012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-oauth-config\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.143186 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.143039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-serving-cert\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.143186 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.143061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-service-ca\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.143186 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.143116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-config\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.143464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.143193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-trusted-ca-bundle\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.143858 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.143833 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-oauth-serving-cert\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.144048 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.143885 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-config\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.144187 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.144055 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-trusted-ca-bundle\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.144187 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.144088 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58128ae7-2139-43b4-bc9a-0b9d2165efcf-service-ca\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.145606 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.145586 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-oauth-config\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.145698 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.145654 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58128ae7-2139-43b4-bc9a-0b9d2165efcf-console-serving-cert\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.150732 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.150713 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgr86\" (UniqueName: \"kubernetes.io/projected/58128ae7-2139-43b4-bc9a-0b9d2165efcf-kube-api-access-hgr86\") pod \"console-5d949b6f5f-hdf8w\" (UID: \"58128ae7-2139-43b4-bc9a-0b9d2165efcf\") " pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.242972 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.242868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:38.381449 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.381399 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d949b6f5f-hdf8w"] Jul 17 13:25:38.384645 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:25:38.384614 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58128ae7_2139_43b4_bc9a_0b9d2165efcf.slice/crio-4ab2051f94add9b2f19338906a495e728762d68bc62d62675213de2ccce82630 WatchSource:0}: Error finding container 4ab2051f94add9b2f19338906a495e728762d68bc62d62675213de2ccce82630: Status 404 returned error can't find the container with id 4ab2051f94add9b2f19338906a495e728762d68bc62d62675213de2ccce82630 Jul 17 13:25:38.569596 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.569560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d949b6f5f-hdf8w" event={"ID":"58128ae7-2139-43b4-bc9a-0b9d2165efcf","Type":"ContainerStarted","Data":"782eaed0dabfd6010b5d608ba28225aa7bbd58293576a6885c1ec8a7a2f01c85"} Jul 17 13:25:38.569802 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.569612 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d949b6f5f-hdf8w" event={"ID":"58128ae7-2139-43b4-bc9a-0b9d2165efcf","Type":"ContainerStarted","Data":"4ab2051f94add9b2f19338906a495e728762d68bc62d62675213de2ccce82630"} Jul 17 13:25:38.586307 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:38.586249 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d949b6f5f-hdf8w" podStartSLOduration=1.586234022 podStartE2EDuration="1.586234022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:25:38.585530116 +0000 UTC m=+408.254065860" watchObservedRunningTime="2026-07-17 13:25:38.586234022 +0000 UTC m=+408.254769761" Jul 17 13:25:48.243407 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:48.243360 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:48.243813 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:48.243430 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:48.248228 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:48.248200 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:48.614987 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:48.614952 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d949b6f5f-hdf8w" Jul 17 13:25:48.657768 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:25:48.657726 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f489c6d-gw62p"] Jul 17 13:26:13.685566 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:13.685473 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f9f489c6d-gw62p" podUID="7ca25be4-8121-4bc1-bbaf-9141a77d580f" containerName="console" containerID="cri-o://9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30" gracePeriod=15 Jul 17 13:26:13.928586 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:13.928563 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:26:14.033585 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.033537 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-oauth-config\") pod \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " Jul 17 13:26:14.033776 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.033597 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-trusted-ca-bundle\") pod \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " Jul 17 13:26:14.033776 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.033617 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-oauth-serving-cert\") pod \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " Jul 17 13:26:14.033776 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.033650 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-serving-cert\") pod \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " Jul 17 13:26:14.033776 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.033679 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-config\") pod \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " Jul 17 13:26:14.033776 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.033711 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-service-ca\") pod \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " Jul 17 13:26:14.033776 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.033765 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjtmm\" (UniqueName: \"kubernetes.io/projected/7ca25be4-8121-4bc1-bbaf-9141a77d580f-kube-api-access-kjtmm\") pod \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\" (UID: \"7ca25be4-8121-4bc1-bbaf-9141a77d580f\") " Jul 17 13:26:14.034094 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.034058 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ca25be4-8121-4bc1-bbaf-9141a77d580f" (UID: "7ca25be4-8121-4bc1-bbaf-9141a77d580f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:26:14.034295 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.034268 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7ca25be4-8121-4bc1-bbaf-9141a77d580f" (UID: "7ca25be4-8121-4bc1-bbaf-9141a77d580f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:26:14.034433 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.034392 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ca25be4-8121-4bc1-bbaf-9141a77d580f" (UID: "7ca25be4-8121-4bc1-bbaf-9141a77d580f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:26:14.034433 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.034386 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-config" (OuterVolumeSpecName: "console-config") pod "7ca25be4-8121-4bc1-bbaf-9141a77d580f" (UID: "7ca25be4-8121-4bc1-bbaf-9141a77d580f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:26:14.035970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.035941 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ca25be4-8121-4bc1-bbaf-9141a77d580f" (UID: "7ca25be4-8121-4bc1-bbaf-9141a77d580f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:26:14.035970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.035959 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ca25be4-8121-4bc1-bbaf-9141a77d580f" (UID: "7ca25be4-8121-4bc1-bbaf-9141a77d580f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:26:14.036106 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.036026 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca25be4-8121-4bc1-bbaf-9141a77d580f-kube-api-access-kjtmm" (OuterVolumeSpecName: "kube-api-access-kjtmm") pod "7ca25be4-8121-4bc1-bbaf-9141a77d580f" (UID: "7ca25be4-8121-4bc1-bbaf-9141a77d580f"). InnerVolumeSpecName "kube-api-access-kjtmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:26:14.134730 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.134677 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-serving-cert\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:26:14.134730 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.134724 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-config\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:26:14.134730 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.134738 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-service-ca\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:26:14.134970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.134750 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjtmm\" (UniqueName: \"kubernetes.io/projected/7ca25be4-8121-4bc1-bbaf-9141a77d580f-kube-api-access-kjtmm\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:26:14.134970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.134763 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ca25be4-8121-4bc1-bbaf-9141a77d580f-console-oauth-config\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:26:14.134970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.134776 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-trusted-ca-bundle\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:26:14.134970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.134787 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ca25be4-8121-4bc1-bbaf-9141a77d580f-oauth-serving-cert\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:26:14.707077 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.707044 2582 generic.go:356] "Generic (PLEG): container finished" podID="7ca25be4-8121-4bc1-bbaf-9141a77d580f" containerID="9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30" exitCode=0 Jul 17 13:26:14.707489 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.707103 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9f489c6d-gw62p" Jul 17 13:26:14.707489 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.707123 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f489c6d-gw62p" event={"ID":"7ca25be4-8121-4bc1-bbaf-9141a77d580f","Type":"ContainerDied","Data":"9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30"} Jul 17 13:26:14.707489 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.707198 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9f489c6d-gw62p" event={"ID":"7ca25be4-8121-4bc1-bbaf-9141a77d580f","Type":"ContainerDied","Data":"97a7a95e0aca4b40d5739a3d622b1701bc6d9d419e38055fa7e84940033acd0a"} Jul 17 13:26:14.707489 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.707217 2582 scope.go:117] "RemoveContainer" containerID="9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30" Jul 17 13:26:14.715902 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.715886 2582 scope.go:117] "RemoveContainer" containerID="9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30" Jul 17 13:26:14.716174 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:26:14.716136 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30\": container with ID starting with 9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30 not found: ID does not exist" containerID="9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30" Jul 17 13:26:14.716223 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.716184 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30"} err="failed to get container status \"9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30\": rpc error: code = NotFound desc = could not find container \"9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30\": container with ID starting with 9076d2b5dd9e8781bd816c64358ed5521a3881fd881647a409af782b781eaa30 not found: ID does not exist" Jul 17 13:26:14.727032 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.727006 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9f489c6d-gw62p"] Jul 17 13:26:14.730246 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.730221 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9f489c6d-gw62p"] Jul 17 13:26:14.847320 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:26:14.847287 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca25be4-8121-4bc1-bbaf-9141a77d580f" path="/var/lib/kubelet/pods/7ca25be4-8121-4bc1-bbaf-9141a77d580f/volumes" Jul 17 13:28:50.796779 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:28:50.796750 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:28:50.799618 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:28:50.799594 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:28:50.807661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:28:50.807640 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:28:50.810039 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:28:50.810021 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:30:24.559799 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.559764 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-d8zcz"] Jul 17 13:30:24.560395 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.560125 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca25be4-8121-4bc1-bbaf-9141a77d580f" containerName="console" Jul 17 13:30:24.560395 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.560139 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca25be4-8121-4bc1-bbaf-9141a77d580f" containerName="console" Jul 17 13:30:24.560395 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.560226 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca25be4-8121-4bc1-bbaf-9141a77d580f" containerName="console" Jul 17 13:30:24.563138 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.563122 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-d8zcz" Jul 17 13:30:24.565437 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.565411 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 17 13:30:24.565686 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.565669 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 13:30:24.566461 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.566442 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 13:30:24.566553 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.566465 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-9kq56\"" Jul 17 13:30:24.569528 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.569507 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-d8zcz"] Jul 17 13:30:24.714842 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.714800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56cr\" (UniqueName: \"kubernetes.io/projected/38034f3b-5944-4020-83e0-fa7d8685e90d-kube-api-access-k56cr\") pod \"feast-test-apply-d8zcz\" (UID: \"38034f3b-5944-4020-83e0-fa7d8685e90d\") " pod="test-ns-feast/feast-test-apply-d8zcz" Jul 17 13:30:24.815860 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.815760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56cr\" (UniqueName: \"kubernetes.io/projected/38034f3b-5944-4020-83e0-fa7d8685e90d-kube-api-access-k56cr\") pod \"feast-test-apply-d8zcz\" (UID: \"38034f3b-5944-4020-83e0-fa7d8685e90d\") " pod="test-ns-feast/feast-test-apply-d8zcz" Jul 17 13:30:24.823355 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.823328 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56cr\" (UniqueName: \"kubernetes.io/projected/38034f3b-5944-4020-83e0-fa7d8685e90d-kube-api-access-k56cr\") pod \"feast-test-apply-d8zcz\" (UID: \"38034f3b-5944-4020-83e0-fa7d8685e90d\") " pod="test-ns-feast/feast-test-apply-d8zcz" Jul 17 13:30:24.881192 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:24.881134 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-d8zcz" Jul 17 13:30:25.009768 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:25.009727 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-d8zcz"] Jul 17 13:30:25.012478 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:30:25.012446 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38034f3b_5944_4020_83e0_fa7d8685e90d.slice/crio-a99c882ec31c27e4ad6c874ba771a6639a6ff85ab64b07ffe66f61abf0aaf7ae WatchSource:0}: Error finding container a99c882ec31c27e4ad6c874ba771a6639a6ff85ab64b07ffe66f61abf0aaf7ae: Status 404 returned error can't find the container with id a99c882ec31c27e4ad6c874ba771a6639a6ff85ab64b07ffe66f61abf0aaf7ae Jul 17 13:30:25.014266 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:25.014249 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:30:25.654356 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:25.654318 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-d8zcz" event={"ID":"38034f3b-5944-4020-83e0-fa7d8685e90d","Type":"ContainerStarted","Data":"a99c882ec31c27e4ad6c874ba771a6639a6ff85ab64b07ffe66f61abf0aaf7ae"} Jul 17 13:30:30.677102 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:30.677063 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-d8zcz" event={"ID":"38034f3b-5944-4020-83e0-fa7d8685e90d","Type":"ContainerStarted","Data":"0a6d8281dcae416a52fffcfee984b2672f453b608b4b88a2889adc775a67bb47"} Jul 17 13:30:36.701243 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:36.701200 2582 generic.go:356] "Generic (PLEG): container finished" podID="38034f3b-5944-4020-83e0-fa7d8685e90d" containerID="0a6d8281dcae416a52fffcfee984b2672f453b608b4b88a2889adc775a67bb47" exitCode=0 Jul 17 13:30:36.701635 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:36.701270 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-d8zcz" event={"ID":"38034f3b-5944-4020-83e0-fa7d8685e90d","Type":"ContainerDied","Data":"0a6d8281dcae416a52fffcfee984b2672f453b608b4b88a2889adc775a67bb47"} Jul 17 13:30:37.706842 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:37.706805 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-d8zcz" event={"ID":"38034f3b-5944-4020-83e0-fa7d8685e90d","Type":"ContainerStarted","Data":"77d95f92ad570f8a87bf6b2948c6ae3fbb8e3148b69d480ca23f77bdcfc39dae"} Jul 17 13:30:37.722271 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:37.722211 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-d8zcz" podStartSLOduration=2.628444977 podStartE2EDuration="13.722193125s" totalImagesPullingTime="4.867932069s" totalInitContainerRuntime="6.225816079s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:30:37.720202981 +0000 UTC m=+707.388738723" watchObservedRunningTime="2026-07-17 13:30:37.722193125 +0000 UTC m=+707.390728861" Jul 17 13:30:46.745187 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:46.745130 2582 generic.go:356] "Generic (PLEG): container finished" podID="38034f3b-5944-4020-83e0-fa7d8685e90d" containerID="77d95f92ad570f8a87bf6b2948c6ae3fbb8e3148b69d480ca23f77bdcfc39dae" exitCode=0 Jul 17 13:30:46.745187 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:46.745191 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-d8zcz" event={"ID":"38034f3b-5944-4020-83e0-fa7d8685e90d","Type":"ContainerDied","Data":"77d95f92ad570f8a87bf6b2948c6ae3fbb8e3148b69d480ca23f77bdcfc39dae"} Jul 17 13:30:47.880588 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:47.880559 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-d8zcz" Jul 17 13:30:47.991984 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:47.991947 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k56cr\" (UniqueName: \"kubernetes.io/projected/38034f3b-5944-4020-83e0-fa7d8685e90d-kube-api-access-k56cr\") pod \"38034f3b-5944-4020-83e0-fa7d8685e90d\" (UID: \"38034f3b-5944-4020-83e0-fa7d8685e90d\") " Jul 17 13:30:47.994189 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:47.994157 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38034f3b-5944-4020-83e0-fa7d8685e90d-kube-api-access-k56cr" (OuterVolumeSpecName: "kube-api-access-k56cr") pod "38034f3b-5944-4020-83e0-fa7d8685e90d" (UID: "38034f3b-5944-4020-83e0-fa7d8685e90d"). InnerVolumeSpecName "kube-api-access-k56cr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:30:48.092774 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:48.092733 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k56cr\" (UniqueName: \"kubernetes.io/projected/38034f3b-5944-4020-83e0-fa7d8685e90d-kube-api-access-k56cr\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:30:48.754032 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:48.753997 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-d8zcz" Jul 17 13:30:48.754202 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:48.753997 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-d8zcz" event={"ID":"38034f3b-5944-4020-83e0-fa7d8685e90d","Type":"ContainerDied","Data":"a99c882ec31c27e4ad6c874ba771a6639a6ff85ab64b07ffe66f61abf0aaf7ae"} Jul 17 13:30:48.754202 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:48.754113 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a99c882ec31c27e4ad6c874ba771a6639a6ff85ab64b07ffe66f61abf0aaf7ae" Jul 17 13:30:48.922255 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:48.922222 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-d8zcz_38034f3b-5944-4020-83e0-fa7d8685e90d/feast-0/0.log" Jul 17 13:30:48.928930 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:30:48.928908 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-d8zcz_38034f3b-5944-4020-83e0-fa7d8685e90d/feast-1/0.log" Jul 17 13:31:25.164326 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:31:25.164287 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-d8zcz"] Jul 17 13:31:25.168271 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:31:25.168242 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-d8zcz"] Jul 17 13:31:26.848249 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:31:26.848213 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38034f3b-5944-4020-83e0-fa7d8685e90d" path="/var/lib/kubelet/pods/38034f3b-5944-4020-83e0-fa7d8685e90d/volumes" Jul 17 13:33:50.827575 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:33:50.827504 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:33:50.830626 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:33:50.830603 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:33:50.831502 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:33:50.831482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:33:50.834314 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:33:50.834296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:36:50.888636 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:36:50.888555 2582 scope.go:117] "RemoveContainer" containerID="77d95f92ad570f8a87bf6b2948c6ae3fbb8e3148b69d480ca23f77bdcfc39dae" Jul 17 13:36:50.895837 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:36:50.895819 2582 scope.go:117] "RemoveContainer" containerID="0a6d8281dcae416a52fffcfee984b2672f453b608b4b88a2889adc775a67bb47" Jul 17 13:38:13.834723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:13.834633 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs"] Jul 17 13:38:13.835294 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:13.834880 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" podUID="6daa09eb-3cc2-4b26-acaa-1a7d8b065fed" containerName="manager" containerID="cri-o://034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde" gracePeriod=10 Jul 17 13:38:14.104437 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.104410 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:38:14.172075 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.172041 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbk79\" (UniqueName: \"kubernetes.io/projected/6daa09eb-3cc2-4b26-acaa-1a7d8b065fed-kube-api-access-jbk79\") pod \"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed\" (UID: \"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed\") " Jul 17 13:38:14.174137 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.174114 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6daa09eb-3cc2-4b26-acaa-1a7d8b065fed-kube-api-access-jbk79" (OuterVolumeSpecName: "kube-api-access-jbk79") pod "6daa09eb-3cc2-4b26-acaa-1a7d8b065fed" (UID: "6daa09eb-3cc2-4b26-acaa-1a7d8b065fed"). InnerVolumeSpecName "kube-api-access-jbk79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:38:14.272670 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.272630 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbk79\" (UniqueName: \"kubernetes.io/projected/6daa09eb-3cc2-4b26-acaa-1a7d8b065fed-kube-api-access-jbk79\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:38:14.431195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.431094 2582 generic.go:356] "Generic (PLEG): container finished" podID="6daa09eb-3cc2-4b26-acaa-1a7d8b065fed" containerID="034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde" exitCode=0 Jul 17 13:38:14.431195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.431136 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" Jul 17 13:38:14.431407 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.431135 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" event={"ID":"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed","Type":"ContainerDied","Data":"034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde"} Jul 17 13:38:14.431407 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.431265 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs" event={"ID":"6daa09eb-3cc2-4b26-acaa-1a7d8b065fed","Type":"ContainerDied","Data":"d4e00b8389c849ca76edb407c2c871262c9ab9579f9f3a6117cd33fb971ed58a"} Jul 17 13:38:14.431407 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.431295 2582 scope.go:117] "RemoveContainer" containerID="034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde" Jul 17 13:38:14.445157 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.445124 2582 scope.go:117] "RemoveContainer" containerID="034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde" Jul 17 13:38:14.445443 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:38:14.445423 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde\": container with ID starting with 034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde not found: ID does not exist" containerID="034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde" Jul 17 13:38:14.445498 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.445451 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde"} err="failed to get container status \"034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde\": rpc error: code = NotFound desc = could not find container \"034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde\": container with ID starting with 034f4ca435cc8b9d9127ecde2339c2093432c65158190d89e7059f0d31aa4bde not found: ID does not exist" Jul 17 13:38:14.453724 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.453701 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs"] Jul 17 13:38:14.456919 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.456893 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6c76bd89bc-mnhjs"] Jul 17 13:38:14.847277 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:14.847240 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6daa09eb-3cc2-4b26-acaa-1a7d8b065fed" path="/var/lib/kubelet/pods/6daa09eb-3cc2-4b26-acaa-1a7d8b065fed/volumes" Jul 17 13:38:43.520618 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520583 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh"] Jul 17 13:38:43.520974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520870 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6daa09eb-3cc2-4b26-acaa-1a7d8b065fed" containerName="manager" Jul 17 13:38:43.520974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520883 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6daa09eb-3cc2-4b26-acaa-1a7d8b065fed" containerName="manager" Jul 17 13:38:43.520974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520905 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38034f3b-5944-4020-83e0-fa7d8685e90d" containerName="feast-0" Jul 17 13:38:43.520974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520911 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38034f3b-5944-4020-83e0-fa7d8685e90d" containerName="feast-0" Jul 17 13:38:43.520974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520921 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38034f3b-5944-4020-83e0-fa7d8685e90d" containerName="feast-1" Jul 17 13:38:43.520974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520927 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38034f3b-5944-4020-83e0-fa7d8685e90d" containerName="feast-1" Jul 17 13:38:43.521195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520979 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6daa09eb-3cc2-4b26-acaa-1a7d8b065fed" containerName="manager" Jul 17 13:38:43.521195 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.520987 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38034f3b-5944-4020-83e0-fa7d8685e90d" containerName="feast-1" Jul 17 13:38:43.524462 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.524446 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.526540 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.526510 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 17 13:38:43.526666 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.526575 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 13:38:43.526666 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.526581 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 17 13:38:43.526666 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.526633 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 17 13:38:43.526797 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.526667 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 13:38:43.526860 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.526848 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 17 13:38:43.527268 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.527250 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4kzdz\"" Jul 17 13:38:43.535343 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.535305 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh"] Jul 17 13:38:43.569841 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.569810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.569841 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.569843 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.570056 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.569869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.570056 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.569929 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12a53cab-37d0-4da5-9ea4-a935345195bd-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.570056 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.570003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.570056 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.570035 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7jqd\" (UniqueName: \"kubernetes.io/projected/12a53cab-37d0-4da5-9ea4-a935345195bd-kube-api-access-c7jqd\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.671236 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.671130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.671425 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.671271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.671425 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.671297 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12a53cab-37d0-4da5-9ea4-a935345195bd-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.671425 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.671331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.671425 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.671372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7jqd\" (UniqueName: \"kubernetes.io/projected/12a53cab-37d0-4da5-9ea4-a935345195bd-kube-api-access-c7jqd\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.671644 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:38:43.671436 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 17 13:38:43.671644 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:38:43.671507 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls podName:12a53cab-37d0-4da5-9ea4-a935345195bd nodeName:}" failed. No retries permitted until 2026-07-17 13:38:44.171491285 +0000 UTC m=+1193.840027002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls") pod "feast-simple-feast-setup-796bc5bb56-hlffh" (UID: "12a53cab-37d0-4da5-9ea4-a935345195bd") : secret "feast-simple-feast-setup-ui-tls" not found Jul 17 13:38:43.671644 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.671438 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.671813 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.671718 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12a53cab-37d0-4da5-9ea4-a935345195bd-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.673587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.673566 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.673838 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.673818 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.673838 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.673831 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:43.679239 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:43.679216 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7jqd\" (UniqueName: \"kubernetes.io/projected/12a53cab-37d0-4da5-9ea4-a935345195bd-kube-api-access-c7jqd\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:44.175676 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:44.175613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:44.178190 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:44.178142 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-hlffh\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:44.447404 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:44.447311 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:38:44.579319 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:44.579293 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh"] Jul 17 13:38:44.580769 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:38:44.580743 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12a53cab_37d0_4da5_9ea4_a935345195bd.slice/crio-63ca54cbd82b4612a6d5c82876507229222914f278b6fe3028389c48528cd4ad WatchSource:0}: Error finding container 63ca54cbd82b4612a6d5c82876507229222914f278b6fe3028389c48528cd4ad: Status 404 returned error can't find the container with id 63ca54cbd82b4612a6d5c82876507229222914f278b6fe3028389c48528cd4ad Jul 17 13:38:44.582409 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:44.582390 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:38:45.556973 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:45.556879 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerStarted","Data":"63ca54cbd82b4612a6d5c82876507229222914f278b6fe3028389c48528cd4ad"} Jul 17 13:38:51.292163 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:51.292123 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:38:51.292163 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:51.292139 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:38:51.295592 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:51.295571 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:38:51.295729 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:38:51.295592 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:39:00.630870 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:00.630831 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerStarted","Data":"ca617c85e6055fbe8a13f984ff188cdd2696fc75217d7ed98ef73f6b261e3052"} Jul 17 13:39:05.652240 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:05.652204 2582 generic.go:356] "Generic (PLEG): container finished" podID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerID="ca617c85e6055fbe8a13f984ff188cdd2696fc75217d7ed98ef73f6b261e3052" exitCode=0 Jul 17 13:39:05.652240 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:05.652244 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerDied","Data":"ca617c85e6055fbe8a13f984ff188cdd2696fc75217d7ed98ef73f6b261e3052"} Jul 17 13:39:06.658464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:06.658419 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerStarted","Data":"822075839fb7b5271711905b443d9080f0bc963079d1edc6f45948498e168ae9"} Jul 17 13:39:12.684724 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:12.684680 2582 generic.go:356] "Generic (PLEG): container finished" podID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerID="822075839fb7b5271711905b443d9080f0bc963079d1edc6f45948498e168ae9" exitCode=0 Jul 17 13:39:12.685133 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:12.684758 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerDied","Data":"822075839fb7b5271711905b443d9080f0bc963079d1edc6f45948498e168ae9"} Jul 17 13:39:13.694263 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:13.694214 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerStarted","Data":"e685cdc16287fd2c8a297d00f87bf6c36ef6910ef6406ccbb8d968e9bad6c1fe"} Jul 17 13:39:13.694724 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:13.694288 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerStarted","Data":"e09a584f8e07d26f2701ae779604f7550671019e24c6e9a8fff92abf6e99cb38"} Jul 17 13:39:13.694724 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:13.694314 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerStarted","Data":"9d5ba92ff46eead98f9df29c58b1101d3686d4f918543b3a4e318ab8a9a57066"} Jul 17 13:39:13.694724 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:13.694332 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerStarted","Data":"dfb80e7e383bf8cf6d044e17e66c663a79d1aa0a02c7fb885a1d18fd3538d44b"} Jul 17 13:39:13.717197 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:13.717096 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podStartSLOduration=15.235399365 podStartE2EDuration="30.717074743s" totalImagesPullingTime="15.481675378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:39:13.71580676 +0000 UTC m=+1223.384342501" watchObservedRunningTime="2026-07-17 13:39:13.717074743 +0000 UTC m=+1223.385610483" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.447983 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.448263 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.448306 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.448326 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.448345 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.448363 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.448380 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.448427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.448396 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:14.450627 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.450586 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 17 13:39:14.450890 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.450615 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Jul 17 13:39:14.450986 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.450622 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused" Jul 17 13:39:14.450986 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:14.450678 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 17 13:39:17.447716 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:17.447668 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused" Jul 17 13:39:17.448258 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:17.447727 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 17 13:39:17.448258 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:17.447947 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Jul 17 13:39:17.448258 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:17.448164 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 17 13:39:20.448976 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.448932 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:20.449361 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.449164 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:20.449929 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.449902 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:20.450248 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.450140 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:20.450421 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.450409 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:20.454465 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.454442 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:20.739617 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.739335 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:39:20.746824 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:39:20.746797 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:40:22.914056 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:22.914012 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh"] Jul 17 13:40:22.915012 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:22.914972 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="registry" containerID="cri-o://dfb80e7e383bf8cf6d044e17e66c663a79d1aa0a02c7fb885a1d18fd3538d44b" gracePeriod=30 Jul 17 13:40:22.915414 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:22.915385 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="offline" containerID="cri-o://e09a584f8e07d26f2701ae779604f7550671019e24c6e9a8fff92abf6e99cb38" gracePeriod=30 Jul 17 13:40:22.916192 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:22.915512 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" containerID="cri-o://9d5ba92ff46eead98f9df29c58b1101d3686d4f918543b3a4e318ab8a9a57066" gracePeriod=30 Jul 17 13:40:22.916455 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:22.915391 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" containerID="cri-o://e685cdc16287fd2c8a297d00f87bf6c36ef6910ef6406ccbb8d968e9bad6c1fe" gracePeriod=30 Jul 17 13:40:23.187707 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.187625 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww"] Jul 17 13:40:23.191436 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.191417 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.193626 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.193602 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-7gv7r\"" Jul 17 13:40:23.201282 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.201259 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww"] Jul 17 13:40:23.297429 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.297390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/be54d8bc-d4a9-4592-aec3-09615f65ff83-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.297429 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.297426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwx74\" (UniqueName: \"kubernetes.io/projected/be54d8bc-d4a9-4592-aec3-09615f65ff83-kube-api-access-gwx74\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.297697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.297526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.297697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.297577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.297697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.297649 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.297697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.297678 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.398993 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.398953 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.398993 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.398993 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.399287 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.399026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/be54d8bc-d4a9-4592-aec3-09615f65ff83-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.399287 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.399050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwx74\" (UniqueName: \"kubernetes.io/projected/be54d8bc-d4a9-4592-aec3-09615f65ff83-kube-api-access-gwx74\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.399287 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.399129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.399287 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.399180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.399287 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:40:23.399287 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 17 13:40:23.399589 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:40:23.399346 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls podName:be54d8bc-d4a9-4592-aec3-09615f65ff83 nodeName:}" failed. No retries permitted until 2026-07-17 13:40:23.899326386 +0000 UTC m=+1293.567862104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls") pod "feast-simple-feast-setup-796bc5bb56-tkqww" (UID: "be54d8bc-d4a9-4592-aec3-09615f65ff83") : secret "feast-simple-feast-setup-registry-tls" not found Jul 17 13:40:23.399589 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.399473 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/be54d8bc-d4a9-4592-aec3-09615f65ff83-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.401949 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.401913 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.402197 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.402176 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.402289 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.402244 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.409219 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.409192 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwx74\" (UniqueName: \"kubernetes.io/projected/be54d8bc-d4a9-4592-aec3-09615f65ff83-kube-api-access-gwx74\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.904468 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.904413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.906759 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.906732 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-tkqww\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:23.980472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.980442 2582 generic.go:356] "Generic (PLEG): container finished" podID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerID="e685cdc16287fd2c8a297d00f87bf6c36ef6910ef6406ccbb8d968e9bad6c1fe" exitCode=0 Jul 17 13:40:23.980472 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.980469 2582 generic.go:356] "Generic (PLEG): container finished" podID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerID="9d5ba92ff46eead98f9df29c58b1101d3686d4f918543b3a4e318ab8a9a57066" exitCode=0 Jul 17 13:40:23.980869 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.980510 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerDied","Data":"e685cdc16287fd2c8a297d00f87bf6c36ef6910ef6406ccbb8d968e9bad6c1fe"} Jul 17 13:40:23.980869 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:23.980552 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerDied","Data":"9d5ba92ff46eead98f9df29c58b1101d3686d4f918543b3a4e318ab8a9a57066"} Jul 17 13:40:24.101047 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:24.101010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:24.233665 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:24.233638 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww"] Jul 17 13:40:24.235336 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:40:24.235311 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe54d8bc_d4a9_4592_aec3_09615f65ff83.slice/crio-56b814876bec60b09360c9c244b3e4c90c122eec158124ad78cd799d09172954 WatchSource:0}: Error finding container 56b814876bec60b09360c9c244b3e4c90c122eec158124ad78cd799d09172954: Status 404 returned error can't find the container with id 56b814876bec60b09360c9c244b3e4c90c122eec158124ad78cd799d09172954 Jul 17 13:40:24.986330 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:24.986286 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerStarted","Data":"fa2b309157f2ab756101956ee828b567da2f9a8577c7dee633d15e3b0ec71c5c"} Jul 17 13:40:24.986707 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:24.986347 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerStarted","Data":"56b814876bec60b09360c9c244b3e4c90c122eec158124ad78cd799d09172954"} Jul 17 13:40:30.008344 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:30.008307 2582 generic.go:356] "Generic (PLEG): container finished" podID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerID="fa2b309157f2ab756101956ee828b567da2f9a8577c7dee633d15e3b0ec71c5c" exitCode=0 Jul 17 13:40:30.008838 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:30.008384 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerDied","Data":"fa2b309157f2ab756101956ee828b567da2f9a8577c7dee633d15e3b0ec71c5c"} Jul 17 13:40:30.449982 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:30.449927 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 17 13:40:30.739245 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:30.739138 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 17 13:40:31.015429 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:31.015338 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerStarted","Data":"0074f4aacf711e9bddff2a061078b4d5f7073b3f708bcea5c98ee7e52d489a45"} Jul 17 13:40:36.038620 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:36.038586 2582 generic.go:356] "Generic (PLEG): container finished" podID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerID="0074f4aacf711e9bddff2a061078b4d5f7073b3f708bcea5c98ee7e52d489a45" exitCode=0 Jul 17 13:40:36.039000 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:36.038645 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerDied","Data":"0074f4aacf711e9bddff2a061078b4d5f7073b3f708bcea5c98ee7e52d489a45"} Jul 17 13:40:37.050031 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:37.049988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerStarted","Data":"6739e07d1661ae21aba7b3255d3ae9cad9c0895836eda3b6146d8e955c632ea2"} Jul 17 13:40:37.050497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:37.050050 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerStarted","Data":"dc6d8f55b2e9908f548aac256a9bf25f520f18a6dfa4cd9b674823dc89b32959"} Jul 17 13:40:37.050497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:37.050070 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerStarted","Data":"8677b5bc9fc85b2ab1efb082d01411fd66617fe957093999673cee964d51da94"} Jul 17 13:40:37.050497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:37.050089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerStarted","Data":"ea3599c86f429cf0160e651c2837d6ca3e5045e517bde65be9ef94d25cf9dfc1"} Jul 17 13:40:37.072992 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:37.072922 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podStartSLOduration=14.072899349 podStartE2EDuration="14.072899349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:40:37.071459934 +0000 UTC m=+1306.739995691" watchObservedRunningTime="2026-07-17 13:40:37.072899349 +0000 UTC m=+1306.741435080" Jul 17 13:40:39.101435 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.101388 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:39.101897 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.101452 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:39.101897 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.101471 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:39.101897 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.101487 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:39.103575 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.103431 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Jul 17 13:40:39.103575 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.103473 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Jul 17 13:40:39.103575 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.103500 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 13:40:39.103575 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:39.103509 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Jul 17 13:40:40.450504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:40.450441 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 17 13:40:40.739417 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:40.739315 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 17 13:40:42.101723 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.101671 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Jul 17 13:40:42.102494 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.102466 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:42.102635 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.102619 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:42.103052 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.103025 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:42.103190 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.103070 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:42.103587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.103568 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:42.103671 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.103637 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:42.108241 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:42.108219 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:43.082640 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:43.082613 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:43.085845 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:43.085820 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:44.101518 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:44.101478 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:45.102318 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:45.102284 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:46.095136 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:46.095105 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:40:50.450592 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:50.450544 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 17 13:40:50.450978 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:50.450694 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:40:50.739210 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:50.739103 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 17 13:40:50.739355 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:50.739246 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:40:53.129606 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.129575 2582 generic.go:356] "Generic (PLEG): container finished" podID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerID="e09a584f8e07d26f2701ae779604f7550671019e24c6e9a8fff92abf6e99cb38" exitCode=137 Jul 17 13:40:53.129606 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.129600 2582 generic.go:356] "Generic (PLEG): container finished" podID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerID="dfb80e7e383bf8cf6d044e17e66c663a79d1aa0a02c7fb885a1d18fd3538d44b" exitCode=137 Jul 17 13:40:53.129993 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.129649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerDied","Data":"e09a584f8e07d26f2701ae779604f7550671019e24c6e9a8fff92abf6e99cb38"} Jul 17 13:40:53.129993 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.129692 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerDied","Data":"dfb80e7e383bf8cf6d044e17e66c663a79d1aa0a02c7fb885a1d18fd3538d44b"} Jul 17 13:40:53.573763 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.573738 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:40:53.663339 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.663309 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12a53cab-37d0-4da5-9ea4-a935345195bd-feast-data\") pod \"12a53cab-37d0-4da5-9ea4-a935345195bd\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " Jul 17 13:40:53.663339 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.663347 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-registry-tls\") pod \"12a53cab-37d0-4da5-9ea4-a935345195bd\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " Jul 17 13:40:53.663584 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.663363 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-offline-tls\") pod \"12a53cab-37d0-4da5-9ea4-a935345195bd\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " Jul 17 13:40:53.663584 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.663429 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-online-tls\") pod \"12a53cab-37d0-4da5-9ea4-a935345195bd\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " Jul 17 13:40:53.663584 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.663485 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7jqd\" (UniqueName: \"kubernetes.io/projected/12a53cab-37d0-4da5-9ea4-a935345195bd-kube-api-access-c7jqd\") pod \"12a53cab-37d0-4da5-9ea4-a935345195bd\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " Jul 17 13:40:53.663584 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.663515 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls\") pod \"12a53cab-37d0-4da5-9ea4-a935345195bd\" (UID: \"12a53cab-37d0-4da5-9ea4-a935345195bd\") " Jul 17 13:40:53.663974 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.663941 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12a53cab-37d0-4da5-9ea4-a935345195bd-feast-data" (OuterVolumeSpecName: "feast-data") pod "12a53cab-37d0-4da5-9ea4-a935345195bd" (UID: "12a53cab-37d0-4da5-9ea4-a935345195bd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:40:53.665840 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.665812 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "12a53cab-37d0-4da5-9ea4-a935345195bd" (UID: "12a53cab-37d0-4da5-9ea4-a935345195bd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:40:53.665952 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.665835 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-online-tls" (OuterVolumeSpecName: "online-tls") pod "12a53cab-37d0-4da5-9ea4-a935345195bd" (UID: "12a53cab-37d0-4da5-9ea4-a935345195bd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:40:53.665952 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.665857 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12a53cab-37d0-4da5-9ea4-a935345195bd-kube-api-access-c7jqd" (OuterVolumeSpecName: "kube-api-access-c7jqd") pod "12a53cab-37d0-4da5-9ea4-a935345195bd" (UID: "12a53cab-37d0-4da5-9ea4-a935345195bd"). InnerVolumeSpecName "kube-api-access-c7jqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:40:53.666064 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.665958 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "12a53cab-37d0-4da5-9ea4-a935345195bd" (UID: "12a53cab-37d0-4da5-9ea4-a935345195bd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:40:53.666064 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.665979 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "12a53cab-37d0-4da5-9ea4-a935345195bd" (UID: "12a53cab-37d0-4da5-9ea4-a935345195bd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:40:53.764569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.764483 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7jqd\" (UniqueName: \"kubernetes.io/projected/12a53cab-37d0-4da5-9ea4-a935345195bd-kube-api-access-c7jqd\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:40:53.764569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.764515 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-ui-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:40:53.764569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.764525 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12a53cab-37d0-4da5-9ea4-a935345195bd-feast-data\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:40:53.764569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.764534 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-registry-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:40:53.764569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.764542 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-offline-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:40:53.764569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:53.764551 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12a53cab-37d0-4da5-9ea4-a935345195bd-online-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:40:54.136500 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.136462 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" event={"ID":"12a53cab-37d0-4da5-9ea4-a935345195bd","Type":"ContainerDied","Data":"63ca54cbd82b4612a6d5c82876507229222914f278b6fe3028389c48528cd4ad"} Jul 17 13:40:54.136500 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.136486 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh" Jul 17 13:40:54.137097 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.136525 2582 scope.go:117] "RemoveContainer" containerID="e685cdc16287fd2c8a297d00f87bf6c36ef6910ef6406ccbb8d968e9bad6c1fe" Jul 17 13:40:54.145736 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.145715 2582 scope.go:117] "RemoveContainer" containerID="e09a584f8e07d26f2701ae779604f7550671019e24c6e9a8fff92abf6e99cb38" Jul 17 13:40:54.153351 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.153331 2582 scope.go:117] "RemoveContainer" containerID="9d5ba92ff46eead98f9df29c58b1101d3686d4f918543b3a4e318ab8a9a57066" Jul 17 13:40:54.159170 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.159116 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh"] Jul 17 13:40:54.161522 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.161500 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-hlffh"] Jul 17 13:40:54.162282 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.162255 2582 scope.go:117] "RemoveContainer" containerID="dfb80e7e383bf8cf6d044e17e66c663a79d1aa0a02c7fb885a1d18fd3538d44b" Jul 17 13:40:54.169638 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.169621 2582 scope.go:117] "RemoveContainer" containerID="822075839fb7b5271711905b443d9080f0bc963079d1edc6f45948498e168ae9" Jul 17 13:40:54.176408 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.176389 2582 scope.go:117] "RemoveContainer" containerID="ca617c85e6055fbe8a13f984ff188cdd2696fc75217d7ed98ef73f6b261e3052" Jul 17 13:40:54.847669 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:40:54.847638 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" path="/var/lib/kubelet/pods/12a53cab-37d0-4da5-9ea4-a935345195bd/volumes" Jul 17 13:41:48.970463 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970422 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd"] Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970819 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="feast-apply" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970837 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="feast-apply" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970849 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970857 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970887 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="feast-init" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970898 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="feast-init" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970910 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="offline" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970918 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="offline" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970930 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="registry" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970938 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="registry" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970947 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" Jul 17 13:41:48.970970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.970956 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" Jul 17 13:41:48.971587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.971035 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="registry" Jul 17 13:41:48.971587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.971048 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="offline" Jul 17 13:41:48.971587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.971057 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="online" Jul 17 13:41:48.971587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.971066 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a53cab-37d0-4da5-9ea4-a935345195bd" containerName="ui" Jul 17 13:41:48.974736 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.974715 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:48.977019 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.976992 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 17 13:41:48.977019 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.977014 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 17 13:41:48.977222 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.977014 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 17 13:41:48.977222 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.977101 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 17 13:41:48.977222 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.977214 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-srmf2\"" Jul 17 13:41:48.977353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.977325 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 17 13:41:48.977816 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.977800 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 17 13:41:48.984412 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:48.984393 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd"] Jul 17 13:41:49.104471 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.104432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.104471 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.104473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/43ce1615-5dcc-462e-ad67-5762ed3b553a-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.104705 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.104570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzcvr\" (UniqueName: \"kubernetes.io/projected/43ce1615-5dcc-462e-ad67-5762ed3b553a-kube-api-access-kzcvr\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.104705 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.104608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.104705 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.104643 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/43ce1615-5dcc-462e-ad67-5762ed3b553a-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.104705 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.104671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.205814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.205777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.205814 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.205815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/43ce1615-5dcc-462e-ad67-5762ed3b553a-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.206061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.205844 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvr\" (UniqueName: \"kubernetes.io/projected/43ce1615-5dcc-462e-ad67-5762ed3b553a-kube-api-access-kzcvr\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.206061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.205862 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.206061 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:41:49.205940 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 17 13:41:49.206061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.205980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/43ce1615-5dcc-462e-ad67-5762ed3b553a-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.206061 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:41:49.206011 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls podName:43ce1615-5dcc-462e-ad67-5762ed3b553a nodeName:}" failed. No retries permitted until 2026-07-17 13:41:49.705989652 +0000 UTC m=+1379.374525387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls") pod "feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a") : secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 17 13:41:49.206061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.206047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.206439 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:41:49.206173 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Jul 17 13:41:49.206439 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:41:49.206211 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls podName:43ce1615-5dcc-462e-ad67-5762ed3b553a nodeName:}" failed. No retries permitted until 2026-07-17 13:41:49.706199308 +0000 UTC m=+1379.374735025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls") pod "feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a") : secret "feast-simple-feast-remote-setup-online-tls" not found Jul 17 13:41:49.206439 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.206360 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/43ce1615-5dcc-462e-ad67-5762ed3b553a-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.206658 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.206636 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/43ce1615-5dcc-462e-ad67-5762ed3b553a-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.208383 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.208365 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.213624 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.213590 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcvr\" (UniqueName: \"kubernetes.io/projected/43ce1615-5dcc-462e-ad67-5762ed3b553a-kube-api-access-kzcvr\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.711293 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.711245 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.711293 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.711307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.713725 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.713695 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.713836 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.713763 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:49.885091 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:49.885050 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:41:50.022797 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:50.022767 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd"] Jul 17 13:41:50.024466 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:41:50.024438 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43ce1615_5dcc_462e_ad67_5762ed3b553a.slice/crio-8b6a2b4c14eb2c5849682143f1f1697a26fa20fc95b5765df13e3a3eed7ac843 WatchSource:0}: Error finding container 8b6a2b4c14eb2c5849682143f1f1697a26fa20fc95b5765df13e3a3eed7ac843: Status 404 returned error can't find the container with id 8b6a2b4c14eb2c5849682143f1f1697a26fa20fc95b5765df13e3a3eed7ac843 Jul 17 13:41:50.365374 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:50.364597 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerStarted","Data":"f310ca5ddb797511ada013f760bed6229dce7766d1ecc970d439807ad7fafe5f"} Jul 17 13:41:50.365374 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:50.364650 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerStarted","Data":"8b6a2b4c14eb2c5849682143f1f1697a26fa20fc95b5765df13e3a3eed7ac843"} Jul 17 13:41:55.386381 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:55.386339 2582 generic.go:356] "Generic (PLEG): container finished" podID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerID="f310ca5ddb797511ada013f760bed6229dce7766d1ecc970d439807ad7fafe5f" exitCode=0 Jul 17 13:41:55.386763 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:55.386411 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerDied","Data":"f310ca5ddb797511ada013f760bed6229dce7766d1ecc970d439807ad7fafe5f"} Jul 17 13:41:56.392449 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:41:56.392413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerStarted","Data":"6f312ddc5def3769c2b241ad14956d29bc6ff77f457440e2f2f63606bd0492ea"} Jul 17 13:42:01.415034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:01.414999 2582 generic.go:356] "Generic (PLEG): container finished" podID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerID="6f312ddc5def3769c2b241ad14956d29bc6ff77f457440e2f2f63606bd0492ea" exitCode=0 Jul 17 13:42:01.415434 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:01.415050 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerDied","Data":"6f312ddc5def3769c2b241ad14956d29bc6ff77f457440e2f2f63606bd0492ea"} Jul 17 13:42:02.423762 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:02.423718 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerStarted","Data":"1e894985ad965298c402792526210dfc556c4a05e9cf896b3b6dedbcc481152d"} Jul 17 13:42:02.424291 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:02.423790 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerStarted","Data":"6dcb1b8b8d45eb76ae04634d6c810c3c75f4f05a69eb704db4c8f3fe3d6ce57f"} Jul 17 13:42:02.424291 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:02.423812 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerStarted","Data":"be7522b921095ad2db18415e9a98d3ce3bae7c6816ef208c8ff2998153a2c6eb"} Jul 17 13:42:02.445872 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:02.445811 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podStartSLOduration=14.445791389 podStartE2EDuration="14.445791389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:41:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:42:02.443962778 +0000 UTC m=+1392.112498517" watchObservedRunningTime="2026-07-17 13:42:02.445791389 +0000 UTC m=+1392.114327129" Jul 17 13:42:04.886353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:04.886224 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:04.886353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:04.886295 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:04.886353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:04.886316 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:04.888089 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:04.888011 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Jul 17 13:42:04.888089 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:04.888046 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 17 13:42:04.888315 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:04.888047 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Jul 17 13:42:07.886411 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:07.886380 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:07.886817 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:07.886497 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:07.886884 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:07.886862 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:07.886930 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:07.886894 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:07.887082 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:07.887066 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:07.887284 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:07.887263 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:07.892738 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:07.892715 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:08.452812 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:08.452782 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:42:08.457410 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:42:08.457387 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:43:10.413115 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.413024 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd"] Jul 17 13:43:10.413683 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.413509 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" containerID="cri-o://1e894985ad965298c402792526210dfc556c4a05e9cf896b3b6dedbcc481152d" gracePeriod=30 Jul 17 13:43:10.413683 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.413645 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="offline" containerID="cri-o://6dcb1b8b8d45eb76ae04634d6c810c3c75f4f05a69eb704db4c8f3fe3d6ce57f" gracePeriod=30 Jul 17 13:43:10.413828 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.413805 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" containerID="cri-o://be7522b921095ad2db18415e9a98d3ce3bae7c6816ef208c8ff2998153a2c6eb" gracePeriod=30 Jul 17 13:43:10.557201 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.557166 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww"] Jul 17 13:43:10.557475 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.557444 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="registry" containerID="cri-o://ea3599c86f429cf0160e651c2837d6ca3e5045e517bde65be9ef94d25cf9dfc1" gracePeriod=30 Jul 17 13:43:10.557734 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.557501 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" containerID="cri-o://8677b5bc9fc85b2ab1efb082d01411fd66617fe957093999673cee964d51da94" gracePeriod=30 Jul 17 13:43:10.557846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.557511 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" containerID="cri-o://6739e07d1661ae21aba7b3255d3ae9cad9c0895836eda3b6146d8e955c632ea2" gracePeriod=30 Jul 17 13:43:10.557903 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:10.557534 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="offline" containerID="cri-o://dc6d8f55b2e9908f548aac256a9bf25f520f18a6dfa4cd9b674823dc89b32959" gracePeriod=30 Jul 17 13:43:11.709603 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.709566 2582 generic.go:356] "Generic (PLEG): container finished" podID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerID="6739e07d1661ae21aba7b3255d3ae9cad9c0895836eda3b6146d8e955c632ea2" exitCode=0 Jul 17 13:43:11.709603 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.709598 2582 generic.go:356] "Generic (PLEG): container finished" podID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerID="8677b5bc9fc85b2ab1efb082d01411fd66617fe957093999673cee964d51da94" exitCode=0 Jul 17 13:43:11.710121 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.709644 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerDied","Data":"6739e07d1661ae21aba7b3255d3ae9cad9c0895836eda3b6146d8e955c632ea2"} Jul 17 13:43:11.710121 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.709691 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerDied","Data":"8677b5bc9fc85b2ab1efb082d01411fd66617fe957093999673cee964d51da94"} Jul 17 13:43:11.712129 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.712108 2582 generic.go:356] "Generic (PLEG): container finished" podID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerID="1e894985ad965298c402792526210dfc556c4a05e9cf896b3b6dedbcc481152d" exitCode=0 Jul 17 13:43:11.712129 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.712125 2582 generic.go:356] "Generic (PLEG): container finished" podID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerID="be7522b921095ad2db18415e9a98d3ce3bae7c6816ef208c8ff2998153a2c6eb" exitCode=0 Jul 17 13:43:11.712283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.712170 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerDied","Data":"1e894985ad965298c402792526210dfc556c4a05e9cf896b3b6dedbcc481152d"} Jul 17 13:43:11.712283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:11.712205 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerDied","Data":"be7522b921095ad2db18415e9a98d3ce3bae7c6816ef208c8ff2998153a2c6eb"} Jul 17 13:43:13.083461 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:13.083416 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 13:43:16.095208 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:16.095133 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Jul 17 13:43:17.887558 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:17.887513 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Jul 17 13:43:18.453777 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:18.453731 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 17 13:43:23.083418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:23.083370 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 13:43:26.095627 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:26.095577 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Jul 17 13:43:27.887199 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:27.887132 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Jul 17 13:43:28.454041 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:28.453999 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 17 13:43:33.083091 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:33.083047 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 13:43:33.083543 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:33.083214 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:43:36.095062 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:36.095020 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Jul 17 13:43:36.095471 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:36.095138 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:43:37.886992 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:37.886943 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Jul 17 13:43:37.887450 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:37.887081 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:43:38.453378 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:38.453333 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 17 13:43:38.453588 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:38.453451 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:43:40.827178 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:40.827129 2582 generic.go:356] "Generic (PLEG): container finished" podID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerID="6dcb1b8b8d45eb76ae04634d6c810c3c75f4f05a69eb704db4c8f3fe3d6ce57f" exitCode=137 Jul 17 13:43:40.827579 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:40.827182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerDied","Data":"6dcb1b8b8d45eb76ae04634d6c810c3c75f4f05a69eb704db4c8f3fe3d6ce57f"} Jul 17 13:43:40.830099 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:40.830076 2582 generic.go:356] "Generic (PLEG): container finished" podID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerID="dc6d8f55b2e9908f548aac256a9bf25f520f18a6dfa4cd9b674823dc89b32959" exitCode=137 Jul 17 13:43:40.830099 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:40.830095 2582 generic.go:356] "Generic (PLEG): container finished" podID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerID="ea3599c86f429cf0160e651c2837d6ca3e5045e517bde65be9ef94d25cf9dfc1" exitCode=137 Jul 17 13:43:40.830283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:40.830135 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerDied","Data":"dc6d8f55b2e9908f548aac256a9bf25f520f18a6dfa4cd9b674823dc89b32959"} Jul 17 13:43:40.830283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:40.830177 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerDied","Data":"ea3599c86f429cf0160e651c2837d6ca3e5045e517bde65be9ef94d25cf9dfc1"} Jul 17 13:43:41.068453 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.068428 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:43:41.110353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.110263 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzcvr\" (UniqueName: \"kubernetes.io/projected/43ce1615-5dcc-462e-ad67-5762ed3b553a-kube-api-access-kzcvr\") pod \"43ce1615-5dcc-462e-ad67-5762ed3b553a\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " Jul 17 13:43:41.110353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.110304 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-ui-tls\") pod \"43ce1615-5dcc-462e-ad67-5762ed3b553a\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " Jul 17 13:43:41.110353 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.110351 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/43ce1615-5dcc-462e-ad67-5762ed3b553a-feast-data\") pod \"43ce1615-5dcc-462e-ad67-5762ed3b553a\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " Jul 17 13:43:41.110643 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.110374 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/43ce1615-5dcc-462e-ad67-5762ed3b553a-registry-tls\") pod \"43ce1615-5dcc-462e-ad67-5762ed3b553a\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " Jul 17 13:43:41.110643 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.110390 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls\") pod \"43ce1615-5dcc-462e-ad67-5762ed3b553a\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " Jul 17 13:43:41.110643 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.110414 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls\") pod \"43ce1615-5dcc-462e-ad67-5762ed3b553a\" (UID: \"43ce1615-5dcc-462e-ad67-5762ed3b553a\") " Jul 17 13:43:41.111187 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.111119 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ce1615-5dcc-462e-ad67-5762ed3b553a-feast-data" (OuterVolumeSpecName: "feast-data") pod "43ce1615-5dcc-462e-ad67-5762ed3b553a" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:43:41.111187 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.111166 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ce1615-5dcc-462e-ad67-5762ed3b553a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "43ce1615-5dcc-462e-ad67-5762ed3b553a" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:43:41.112713 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.112687 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls" (OuterVolumeSpecName: "online-tls") pod "43ce1615-5dcc-462e-ad67-5762ed3b553a" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:43:41.112921 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.112887 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "43ce1615-5dcc-462e-ad67-5762ed3b553a" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:43:41.112921 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.112888 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ce1615-5dcc-462e-ad67-5762ed3b553a-kube-api-access-kzcvr" (OuterVolumeSpecName: "kube-api-access-kzcvr") pod "43ce1615-5dcc-462e-ad67-5762ed3b553a" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a"). InnerVolumeSpecName "kube-api-access-kzcvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:43:41.113034 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.112977 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "43ce1615-5dcc-462e-ad67-5762ed3b553a" (UID: "43ce1615-5dcc-462e-ad67-5762ed3b553a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:43:41.210616 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.210587 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:43:41.210962 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.210939 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzcvr\" (UniqueName: \"kubernetes.io/projected/43ce1615-5dcc-462e-ad67-5762ed3b553a-kube-api-access-kzcvr\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.211053 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.210962 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-ui-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.211053 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.210973 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/43ce1615-5dcc-462e-ad67-5762ed3b553a-feast-data\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.211053 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.210982 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/43ce1615-5dcc-462e-ad67-5762ed3b553a-registry-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.211053 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.210990 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-offline-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.211053 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.210997 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/43ce1615-5dcc-462e-ad67-5762ed3b553a-online-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.312264 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.312226 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-ui-tls\") pod \"be54d8bc-d4a9-4592-aec3-09615f65ff83\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " Jul 17 13:43:41.312545 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.312287 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/be54d8bc-d4a9-4592-aec3-09615f65ff83-feast-data\") pod \"be54d8bc-d4a9-4592-aec3-09615f65ff83\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " Jul 17 13:43:41.312545 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.312318 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-offline-tls\") pod \"be54d8bc-d4a9-4592-aec3-09615f65ff83\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " Jul 17 13:43:41.312545 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.312352 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwx74\" (UniqueName: \"kubernetes.io/projected/be54d8bc-d4a9-4592-aec3-09615f65ff83-kube-api-access-gwx74\") pod \"be54d8bc-d4a9-4592-aec3-09615f65ff83\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " Jul 17 13:43:41.312545 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.312389 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-online-tls\") pod \"be54d8bc-d4a9-4592-aec3-09615f65ff83\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " Jul 17 13:43:41.312545 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.312410 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls\") pod \"be54d8bc-d4a9-4592-aec3-09615f65ff83\" (UID: \"be54d8bc-d4a9-4592-aec3-09615f65ff83\") " Jul 17 13:43:41.312884 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.312853 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be54d8bc-d4a9-4592-aec3-09615f65ff83-feast-data" (OuterVolumeSpecName: "feast-data") pod "be54d8bc-d4a9-4592-aec3-09615f65ff83" (UID: "be54d8bc-d4a9-4592-aec3-09615f65ff83"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:43:41.314534 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.314500 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-online-tls" (OuterVolumeSpecName: "online-tls") pod "be54d8bc-d4a9-4592-aec3-09615f65ff83" (UID: "be54d8bc-d4a9-4592-aec3-09615f65ff83"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:43:41.314625 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.314549 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "be54d8bc-d4a9-4592-aec3-09615f65ff83" (UID: "be54d8bc-d4a9-4592-aec3-09615f65ff83"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:43:41.314625 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.314561 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "be54d8bc-d4a9-4592-aec3-09615f65ff83" (UID: "be54d8bc-d4a9-4592-aec3-09615f65ff83"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:43:41.314844 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.314828 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "be54d8bc-d4a9-4592-aec3-09615f65ff83" (UID: "be54d8bc-d4a9-4592-aec3-09615f65ff83"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:43:41.314888 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.314831 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be54d8bc-d4a9-4592-aec3-09615f65ff83-kube-api-access-gwx74" (OuterVolumeSpecName: "kube-api-access-gwx74") pod "be54d8bc-d4a9-4592-aec3-09615f65ff83" (UID: "be54d8bc-d4a9-4592-aec3-09615f65ff83"). InnerVolumeSpecName "kube-api-access-gwx74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:43:41.413490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.413407 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-ui-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.413490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.413435 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/be54d8bc-d4a9-4592-aec3-09615f65ff83-feast-data\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.413490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.413446 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-offline-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.413490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.413455 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwx74\" (UniqueName: \"kubernetes.io/projected/be54d8bc-d4a9-4592-aec3-09615f65ff83-kube-api-access-gwx74\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.413490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.413465 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-online-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.413490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.413474 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/be54d8bc-d4a9-4592-aec3-09615f65ff83-registry-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:43:41.836599 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.836563 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" event={"ID":"43ce1615-5dcc-462e-ad67-5762ed3b553a","Type":"ContainerDied","Data":"8b6a2b4c14eb2c5849682143f1f1697a26fa20fc95b5765df13e3a3eed7ac843"} Jul 17 13:43:41.836599 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.836587 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd" Jul 17 13:43:41.837105 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.836620 2582 scope.go:117] "RemoveContainer" containerID="1e894985ad965298c402792526210dfc556c4a05e9cf896b3b6dedbcc481152d" Jul 17 13:43:41.839593 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.839570 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" event={"ID":"be54d8bc-d4a9-4592-aec3-09615f65ff83","Type":"ContainerDied","Data":"56b814876bec60b09360c9c244b3e4c90c122eec158124ad78cd799d09172954"} Jul 17 13:43:41.839729 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.839615 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww" Jul 17 13:43:41.847060 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.847040 2582 scope.go:117] "RemoveContainer" containerID="6dcb1b8b8d45eb76ae04634d6c810c3c75f4f05a69eb704db4c8f3fe3d6ce57f" Jul 17 13:43:41.854450 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.854434 2582 scope.go:117] "RemoveContainer" containerID="be7522b921095ad2db18415e9a98d3ce3bae7c6816ef208c8ff2998153a2c6eb" Jul 17 13:43:41.858364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.858342 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd"] Jul 17 13:43:41.862614 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.862593 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-kj9cd"] Jul 17 13:43:41.862919 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.862903 2582 scope.go:117] "RemoveContainer" containerID="6f312ddc5def3769c2b241ad14956d29bc6ff77f457440e2f2f63606bd0492ea" Jul 17 13:43:41.869791 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.869746 2582 scope.go:117] "RemoveContainer" containerID="f310ca5ddb797511ada013f760bed6229dce7766d1ecc970d439807ad7fafe5f" Jul 17 13:43:41.871510 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.871494 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww"] Jul 17 13:43:41.874929 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.874907 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-tkqww"] Jul 17 13:43:41.877619 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.877592 2582 scope.go:117] "RemoveContainer" containerID="6739e07d1661ae21aba7b3255d3ae9cad9c0895836eda3b6146d8e955c632ea2" Jul 17 13:43:41.884528 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.884512 2582 scope.go:117] "RemoveContainer" containerID="dc6d8f55b2e9908f548aac256a9bf25f520f18a6dfa4cd9b674823dc89b32959" Jul 17 13:43:41.891461 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.891446 2582 scope.go:117] "RemoveContainer" containerID="8677b5bc9fc85b2ab1efb082d01411fd66617fe957093999673cee964d51da94" Jul 17 13:43:41.898212 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.898192 2582 scope.go:117] "RemoveContainer" containerID="ea3599c86f429cf0160e651c2837d6ca3e5045e517bde65be9ef94d25cf9dfc1" Jul 17 13:43:41.904970 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.904955 2582 scope.go:117] "RemoveContainer" containerID="0074f4aacf711e9bddff2a061078b4d5f7073b3f708bcea5c98ee7e52d489a45" Jul 17 13:43:41.911590 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:41.911574 2582 scope.go:117] "RemoveContainer" containerID="fa2b309157f2ab756101956ee828b567da2f9a8577c7dee633d15e3b0ec71c5c" Jul 17 13:43:42.847166 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:42.847104 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" path="/var/lib/kubelet/pods/43ce1615-5dcc-462e-ad67-5762ed3b553a/volumes" Jul 17 13:43:42.847902 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:42.847871 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" path="/var/lib/kubelet/pods/be54d8bc-d4a9-4592-aec3-09615f65ff83/volumes" Jul 17 13:43:51.320182 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:51.320136 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:43:51.323351 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:51.323329 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:43:51.325879 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:51.325858 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:43:51.328355 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:43:51.328338 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:44:20.982549 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982512 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr"] Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982807 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="offline" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982819 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="offline" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982828 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982834 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982845 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="feast-init" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982850 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="feast-init" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982857 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="registry" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982863 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="registry" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982868 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982873 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982879 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982884 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982890 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="offline" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982897 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="offline" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982903 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982907 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982917 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="feast-apply" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982922 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="feast-apply" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982928 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="feast-apply" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982933 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="feast-apply" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982943 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="feast-init" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982947 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="feast-init" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.982992 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="offline" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.983000 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="offline" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.983006 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="online" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.983012 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="registry" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.983017 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="online" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.983022 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be54d8bc-d4a9-4592-aec3-09615f65ff83" containerName="ui" Jul 17 13:44:20.983014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.983027 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ce1615-5dcc-462e-ad67-5762ed3b553a" containerName="ui" Jul 17 13:44:20.987709 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.987691 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:20.989960 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.989936 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 17 13:44:20.990086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.989939 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 17 13:44:20.990086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.989941 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 17 13:44:20.990086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.989946 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-2ft5m\"" Jul 17 13:44:20.990283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.990208 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 17 13:44:20.990283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.990226 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 13:44:20.990283 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.990250 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 13:44:20.996765 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:20.996743 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr"] Jul 17 13:44:21.126028 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.125992 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.126028 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.126029 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwwdc\" (UniqueName: \"kubernetes.io/projected/65bc7118-c325-4e13-ad67-e46826109db0-kube-api-access-mwwdc\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.126279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.126053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.126279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.126071 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.126279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.126177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/65bc7118-c325-4e13-ad67-e46826109db0-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.126279 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.126211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.227302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.227271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/65bc7118-c325-4e13-ad67-e46826109db0-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.227302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.227306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.227551 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.227360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.227551 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.227383 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwwdc\" (UniqueName: \"kubernetes.io/projected/65bc7118-c325-4e13-ad67-e46826109db0-kube-api-access-mwwdc\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.227551 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.227423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.227551 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.227445 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.227551 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:44:21.227481 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 17 13:44:21.227551 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:44:21.227548 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 17 13:44:21.227848 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:44:21.227566 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls podName:65bc7118-c325-4e13-ad67-e46826109db0 nodeName:}" failed. No retries permitted until 2026-07-17 13:44:21.727542522 +0000 UTC m=+1531.396078247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls") pod "feast-simple-feast-setup-796bc5bb56-6vjdr" (UID: "65bc7118-c325-4e13-ad67-e46826109db0") : secret "feast-simple-feast-setup-registry-tls" not found Jul 17 13:44:21.227848 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:44:21.227594 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls podName:65bc7118-c325-4e13-ad67-e46826109db0 nodeName:}" failed. No retries permitted until 2026-07-17 13:44:21.727577886 +0000 UTC m=+1531.396113607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls") pod "feast-simple-feast-setup-796bc5bb56-6vjdr" (UID: "65bc7118-c325-4e13-ad67-e46826109db0") : secret "feast-simple-feast-setup-ui-tls" not found Jul 17 13:44:21.227848 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:44:21.227481 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 17 13:44:21.227848 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:44:21.227628 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls podName:65bc7118-c325-4e13-ad67-e46826109db0 nodeName:}" failed. No retries permitted until 2026-07-17 13:44:21.727618993 +0000 UTC m=+1531.396154710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls") pod "feast-simple-feast-setup-796bc5bb56-6vjdr" (UID: "65bc7118-c325-4e13-ad67-e46826109db0") : secret "feast-simple-feast-setup-online-tls" not found Jul 17 13:44:21.227848 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.227698 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/65bc7118-c325-4e13-ad67-e46826109db0-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.230086 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.230063 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.235398 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.235343 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwwdc\" (UniqueName: \"kubernetes.io/projected/65bc7118-c325-4e13-ad67-e46826109db0-kube-api-access-mwwdc\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.731382 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.731343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.731382 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.731389 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.731714 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.731434 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.733797 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.733770 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.733895 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.733801 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.733895 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.733822 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-6vjdr\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:21.912960 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:21.912923 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:22.045720 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:22.045682 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr"] Jul 17 13:44:22.047874 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:44:22.047847 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65bc7118_c325_4e13_ad67_e46826109db0.slice/crio-7dec8dfc73809119d03eec04751762cbbdee26630c0e089d3a72f4c09255fe8e WatchSource:0}: Error finding container 7dec8dfc73809119d03eec04751762cbbdee26630c0e089d3a72f4c09255fe8e: Status 404 returned error can't find the container with id 7dec8dfc73809119d03eec04751762cbbdee26630c0e089d3a72f4c09255fe8e Jul 17 13:44:22.987716 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:22.987679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerStarted","Data":"1b252ace0c828ba71d0906a2b1586abc523e656f21a0a0769e3a22fd1831fcb1"} Jul 17 13:44:22.987928 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:22.987728 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerStarted","Data":"7dec8dfc73809119d03eec04751762cbbdee26630c0e089d3a72f4c09255fe8e"} Jul 17 13:44:27.003968 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:27.003928 2582 generic.go:356] "Generic (PLEG): container finished" podID="65bc7118-c325-4e13-ad67-e46826109db0" containerID="1b252ace0c828ba71d0906a2b1586abc523e656f21a0a0769e3a22fd1831fcb1" exitCode=0 Jul 17 13:44:27.004471 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:27.003978 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerDied","Data":"1b252ace0c828ba71d0906a2b1586abc523e656f21a0a0769e3a22fd1831fcb1"} Jul 17 13:44:28.009599 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:28.009560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerStarted","Data":"a227c6d26f2023507a6a2b843571b9b9bab63037cf4f18a5b4ec262b156feaf3"} Jul 17 13:44:33.030988 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:33.030952 2582 generic.go:356] "Generic (PLEG): container finished" podID="65bc7118-c325-4e13-ad67-e46826109db0" containerID="a227c6d26f2023507a6a2b843571b9b9bab63037cf4f18a5b4ec262b156feaf3" exitCode=0 Jul 17 13:44:33.031387 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:33.031024 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerDied","Data":"a227c6d26f2023507a6a2b843571b9b9bab63037cf4f18a5b4ec262b156feaf3"} Jul 17 13:44:34.041494 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:34.041448 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerStarted","Data":"a95a6b3a2ee188aadbd473e58bb6d4fafe83f51fae780bb52372605e4e718afc"} Jul 17 13:44:34.042016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:34.041514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerStarted","Data":"caba74a98a48ff3328b78b6e0070b3a609b0634d1c09d9db56dc38a0900690f9"} Jul 17 13:44:34.042016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:34.041537 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerStarted","Data":"959ced4b945ecc9fd04a30f7195e1acdbb47d4c43a8f795c180880139e86684c"} Jul 17 13:44:34.042016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:34.041556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerStarted","Data":"3dd3ab5f4632f860855769317f7f30150323d6ed50a9755765e10a9f75fe66b9"} Jul 17 13:44:34.064988 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:34.064908 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podStartSLOduration=14.064887496 podStartE2EDuration="14.064887496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:44:34.062257933 +0000 UTC m=+1543.730793696" watchObservedRunningTime="2026-07-17 13:44:34.064887496 +0000 UTC m=+1543.733423236" Jul 17 13:44:36.914192 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.914134 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:36.914789 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.914752 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:36.914789 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.914791 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:36.914980 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.914809 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:36.916513 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.916473 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Jul 17 13:44:36.916712 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.916490 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused" Jul 17 13:44:36.916802 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.916496 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused" Jul 17 13:44:36.916802 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:36.916547 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Jul 17 13:44:39.914629 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:39.914594 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:39.915166 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:39.915124 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:39.915292 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:39.915182 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:39.915384 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:39.915336 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:39.915439 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:39.915419 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:39.919935 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:39.919909 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:40.073887 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:40.073854 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:40.074073 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:40.073897 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:40.074073 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:40.073928 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:40.074336 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:40.074310 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:40.074453 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:40.074377 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:44:40.077341 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:44:40.077319 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:45:41.289729 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.289689 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr"] Jul 17 13:45:41.290329 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.290004 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="registry" containerID="cri-o://3dd3ab5f4632f860855769317f7f30150323d6ed50a9755765e10a9f75fe66b9" gracePeriod=30 Jul 17 13:45:41.290329 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.290067 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="offline" containerID="cri-o://caba74a98a48ff3328b78b6e0070b3a609b0634d1c09d9db56dc38a0900690f9" gracePeriod=30 Jul 17 13:45:41.290329 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.290132 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" containerID="cri-o://959ced4b945ecc9fd04a30f7195e1acdbb47d4c43a8f795c180880139e86684c" gracePeriod=30 Jul 17 13:45:41.290329 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.290049 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" containerID="cri-o://a95a6b3a2ee188aadbd473e58bb6d4fafe83f51fae780bb52372605e4e718afc" gracePeriod=30 Jul 17 13:45:41.663056 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.662966 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44"] Jul 17 13:45:41.667451 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.667425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.669751 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.669727 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-hj5h7\"" Jul 17 13:45:41.675725 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.675695 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcshm\" (UniqueName: \"kubernetes.io/projected/773a6eaf-0175-4d66-a0fb-3aba21f4c097-kube-api-access-bcshm\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.675952 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.675930 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.676061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.675979 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.676061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.676010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.676061 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.676046 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.676233 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.676067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/773a6eaf-0175-4d66-a0fb-3aba21f4c097-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.677872 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.677841 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44"] Jul 17 13:45:41.777251 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.777207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcshm\" (UniqueName: \"kubernetes.io/projected/773a6eaf-0175-4d66-a0fb-3aba21f4c097-kube-api-access-bcshm\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.777464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.777295 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.777464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.777328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.777464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.777353 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.777464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.777382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.777464 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.777404 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/773a6eaf-0175-4d66-a0fb-3aba21f4c097-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.777731 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:45:41.777484 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 17 13:45:41.777731 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:45:41.777566 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls podName:773a6eaf-0175-4d66-a0fb-3aba21f4c097 nodeName:}" failed. No retries permitted until 2026-07-17 13:45:42.277545846 +0000 UTC m=+1611.946081578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls") pod "feast-simple-feast-setup-796bc5bb56-jpq44" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097") : secret "feast-simple-feast-setup-ui-tls" not found Jul 17 13:45:41.777731 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:45:41.777493 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 17 13:45:41.777731 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:45:41.777610 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls podName:773a6eaf-0175-4d66-a0fb-3aba21f4c097 nodeName:}" failed. No retries permitted until 2026-07-17 13:45:42.277600466 +0000 UTC m=+1611.946136186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls") pod "feast-simple-feast-setup-796bc5bb56-jpq44" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097") : secret "feast-simple-feast-setup-registry-tls" not found Jul 17 13:45:41.778091 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.778071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/773a6eaf-0175-4d66-a0fb-3aba21f4c097-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.779804 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.779784 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.780130 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.780109 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:41.786001 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:41.785971 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcshm\" (UniqueName: \"kubernetes.io/projected/773a6eaf-0175-4d66-a0fb-3aba21f4c097-kube-api-access-bcshm\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:42.280937 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.280906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:42.281092 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.280948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:42.283370 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.283345 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:42.283485 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.283378 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jpq44\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:42.310694 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.310662 2582 generic.go:356] "Generic (PLEG): container finished" podID="65bc7118-c325-4e13-ad67-e46826109db0" containerID="a95a6b3a2ee188aadbd473e58bb6d4fafe83f51fae780bb52372605e4e718afc" exitCode=0 Jul 17 13:45:42.310694 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.310689 2582 generic.go:356] "Generic (PLEG): container finished" podID="65bc7118-c325-4e13-ad67-e46826109db0" containerID="959ced4b945ecc9fd04a30f7195e1acdbb47d4c43a8f795c180880139e86684c" exitCode=0 Jul 17 13:45:42.311031 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.310730 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerDied","Data":"a95a6b3a2ee188aadbd473e58bb6d4fafe83f51fae780bb52372605e4e718afc"} Jul 17 13:45:42.311031 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.310769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerDied","Data":"959ced4b945ecc9fd04a30f7195e1acdbb47d4c43a8f795c180880139e86684c"} Jul 17 13:45:42.578451 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.578354 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:42.711556 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:42.711528 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44"] Jul 17 13:45:42.712645 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:45:42.712616 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod773a6eaf_0175_4d66_a0fb_3aba21f4c097.slice/crio-185b1e916f5eeee36251f476981ff9622ec58967cd405f59b5b8106daeeb752a WatchSource:0}: Error finding container 185b1e916f5eeee36251f476981ff9622ec58967cd405f59b5b8106daeeb752a: Status 404 returned error can't find the container with id 185b1e916f5eeee36251f476981ff9622ec58967cd405f59b5b8106daeeb752a Jul 17 13:45:43.315878 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:43.315833 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerStarted","Data":"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f"} Jul 17 13:45:43.316263 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:43.315888 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerStarted","Data":"185b1e916f5eeee36251f476981ff9622ec58967cd405f59b5b8106daeeb752a"} Jul 17 13:45:48.336327 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:48.336293 2582 generic.go:356] "Generic (PLEG): container finished" podID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerID="80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f" exitCode=0 Jul 17 13:45:48.336736 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:48.336366 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerDied","Data":"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f"} Jul 17 13:45:49.342504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:49.342469 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerStarted","Data":"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11"} Jul 17 13:45:50.074640 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:50.074592 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Jul 17 13:45:50.074841 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:50.074609 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Jul 17 13:45:54.362862 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:54.362824 2582 generic.go:356] "Generic (PLEG): container finished" podID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerID="b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11" exitCode=0 Jul 17 13:45:54.363297 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:54.362896 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerDied","Data":"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11"} Jul 17 13:45:55.373571 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:55.373525 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerStarted","Data":"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94"} Jul 17 13:45:55.374066 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:55.373589 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerStarted","Data":"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24"} Jul 17 13:45:55.374066 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:55.373610 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerStarted","Data":"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305"} Jul 17 13:45:55.374066 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:55.373628 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerStarted","Data":"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9"} Jul 17 13:45:55.398282 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:55.398218 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podStartSLOduration=14.398195593 podStartE2EDuration="14.398195593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:45:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:45:55.395286464 +0000 UTC m=+1625.063822209" watchObservedRunningTime="2026-07-17 13:45:55.398195593 +0000 UTC m=+1625.066731334" Jul 17 13:45:57.579329 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.579289 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:57.579843 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.579354 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:57.579843 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.579374 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:57.579843 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.579816 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:45:57.581697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.581655 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused" Jul 17 13:45:57.581697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.581687 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 13:45:57.581906 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.581678 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Jul 17 13:45:57.581906 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:45:57.581762 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Jul 17 13:46:00.074504 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.074442 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Jul 17 13:46:00.075006 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.074448 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Jul 17 13:46:00.579597 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.579539 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Jul 17 13:46:00.580263 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.580233 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:00.580440 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.580410 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:00.580785 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.580766 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:00.580878 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.580802 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:00.581177 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.581141 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:00.581250 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.581228 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:00.585550 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:00.585532 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:01.405587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:01.405558 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:01.408864 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:01.408841 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:02.578971 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:02.578934 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:03.580107 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:03.580074 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:04.417349 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:04.417319 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:46:10.074914 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:10.074869 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Jul 17 13:46:10.074914 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:10.074888 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Jul 17 13:46:10.075427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:10.075000 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:46:10.075427 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:10.075083 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:46:11.444685 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:11.444646 2582 generic.go:356] "Generic (PLEG): container finished" podID="65bc7118-c325-4e13-ad67-e46826109db0" containerID="caba74a98a48ff3328b78b6e0070b3a609b0634d1c09d9db56dc38a0900690f9" exitCode=137 Jul 17 13:46:11.444685 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:11.444681 2582 generic.go:356] "Generic (PLEG): container finished" podID="65bc7118-c325-4e13-ad67-e46826109db0" containerID="3dd3ab5f4632f860855769317f7f30150323d6ed50a9755765e10a9f75fe66b9" exitCode=137 Jul 17 13:46:11.445100 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:11.444710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerDied","Data":"caba74a98a48ff3328b78b6e0070b3a609b0634d1c09d9db56dc38a0900690f9"} Jul 17 13:46:11.445100 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:11.444756 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerDied","Data":"3dd3ab5f4632f860855769317f7f30150323d6ed50a9755765e10a9f75fe66b9"} Jul 17 13:46:11.943604 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:11.943580 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:46:12.024089 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.024049 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwwdc\" (UniqueName: \"kubernetes.io/projected/65bc7118-c325-4e13-ad67-e46826109db0-kube-api-access-mwwdc\") pod \"65bc7118-c325-4e13-ad67-e46826109db0\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " Jul 17 13:46:12.024089 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.024094 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-offline-tls\") pod \"65bc7118-c325-4e13-ad67-e46826109db0\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " Jul 17 13:46:12.024376 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.024129 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/65bc7118-c325-4e13-ad67-e46826109db0-feast-data\") pod \"65bc7118-c325-4e13-ad67-e46826109db0\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " Jul 17 13:46:12.024376 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.024298 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls\") pod \"65bc7118-c325-4e13-ad67-e46826109db0\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " Jul 17 13:46:12.024376 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.024332 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls\") pod \"65bc7118-c325-4e13-ad67-e46826109db0\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " Jul 17 13:46:12.024376 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.024356 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls\") pod \"65bc7118-c325-4e13-ad67-e46826109db0\" (UID: \"65bc7118-c325-4e13-ad67-e46826109db0\") " Jul 17 13:46:12.024769 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.024732 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65bc7118-c325-4e13-ad67-e46826109db0-feast-data" (OuterVolumeSpecName: "feast-data") pod "65bc7118-c325-4e13-ad67-e46826109db0" (UID: "65bc7118-c325-4e13-ad67-e46826109db0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:46:12.026687 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.026646 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "65bc7118-c325-4e13-ad67-e46826109db0" (UID: "65bc7118-c325-4e13-ad67-e46826109db0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:46:12.026687 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.026668 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls" (OuterVolumeSpecName: "online-tls") pod "65bc7118-c325-4e13-ad67-e46826109db0" (UID: "65bc7118-c325-4e13-ad67-e46826109db0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:46:12.026857 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.026703 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "65bc7118-c325-4e13-ad67-e46826109db0" (UID: "65bc7118-c325-4e13-ad67-e46826109db0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:46:12.026857 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.026776 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "65bc7118-c325-4e13-ad67-e46826109db0" (UID: "65bc7118-c325-4e13-ad67-e46826109db0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:46:12.026857 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.026785 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65bc7118-c325-4e13-ad67-e46826109db0-kube-api-access-mwwdc" (OuterVolumeSpecName: "kube-api-access-mwwdc") pod "65bc7118-c325-4e13-ad67-e46826109db0" (UID: "65bc7118-c325-4e13-ad67-e46826109db0"). InnerVolumeSpecName "kube-api-access-mwwdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:46:12.125418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.125330 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwwdc\" (UniqueName: \"kubernetes.io/projected/65bc7118-c325-4e13-ad67-e46826109db0-kube-api-access-mwwdc\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:46:12.125418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.125364 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-offline-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:46:12.125418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.125373 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/65bc7118-c325-4e13-ad67-e46826109db0-feast-data\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:46:12.125418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.125381 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-online-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:46:12.125418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.125389 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-ui-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:46:12.125418 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.125397 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/65bc7118-c325-4e13-ad67-e46826109db0-registry-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:46:12.451165 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.451069 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" event={"ID":"65bc7118-c325-4e13-ad67-e46826109db0","Type":"ContainerDied","Data":"7dec8dfc73809119d03eec04751762cbbdee26630c0e089d3a72f4c09255fe8e"} Jul 17 13:46:12.451165 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.451131 2582 scope.go:117] "RemoveContainer" containerID="a95a6b3a2ee188aadbd473e58bb6d4fafe83f51fae780bb52372605e4e718afc" Jul 17 13:46:12.451597 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.451081 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr" Jul 17 13:46:12.460003 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.459978 2582 scope.go:117] "RemoveContainer" containerID="caba74a98a48ff3328b78b6e0070b3a609b0634d1c09d9db56dc38a0900690f9" Jul 17 13:46:12.468231 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.468210 2582 scope.go:117] "RemoveContainer" containerID="959ced4b945ecc9fd04a30f7195e1acdbb47d4c43a8f795c180880139e86684c" Jul 17 13:46:12.474898 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.474869 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr"] Jul 17 13:46:12.476046 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.476026 2582 scope.go:117] "RemoveContainer" containerID="3dd3ab5f4632f860855769317f7f30150323d6ed50a9755765e10a9f75fe66b9" Jul 17 13:46:12.479316 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.479294 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-6vjdr"] Jul 17 13:46:12.483692 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.483664 2582 scope.go:117] "RemoveContainer" containerID="a227c6d26f2023507a6a2b843571b9b9bab63037cf4f18a5b4ec262b156feaf3" Jul 17 13:46:12.491744 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.491728 2582 scope.go:117] "RemoveContainer" containerID="1b252ace0c828ba71d0906a2b1586abc523e656f21a0a0769e3a22fd1831fcb1" Jul 17 13:46:12.847508 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:46:12.847472 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65bc7118-c325-4e13-ad67-e46826109db0" path="/var/lib/kubelet/pods/65bc7118-c325-4e13-ad67-e46826109db0/volumes" Jul 17 13:47:07.089411 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089378 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc"] Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089655 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="offline" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089665 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="offline" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089676 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="registry" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089682 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="registry" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089689 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089696 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089706 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="feast-apply" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089711 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="feast-apply" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089719 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089724 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089733 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="feast-init" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089738 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="feast-init" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089791 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="online" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089801 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="ui" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089807 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="registry" Jul 17 13:47:07.089846 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.089813 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="65bc7118-c325-4e13-ad67-e46826109db0" containerName="offline" Jul 17 13:47:07.093292 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.093272 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.095499 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.095468 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 17 13:47:07.095623 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.095478 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 17 13:47:07.096075 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.095478 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 17 13:47:07.096773 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.096749 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 17 13:47:07.097214 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.097193 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 17 13:47:07.097854 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.097829 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-8g9cg\"" Jul 17 13:47:07.098616 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.097836 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 17 13:47:07.104014 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.103911 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc"] Jul 17 13:47:07.167236 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.167198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2psd\" (UniqueName: \"kubernetes.io/projected/da379d96-ca41-47ab-b9fd-93ea5c13a109-kube-api-access-j2psd\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.167236 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.167241 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da379d96-ca41-47ab-b9fd-93ea5c13a109-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.167445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.167265 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.167445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.167287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.167445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.167303 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.167445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.167331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/da379d96-ca41-47ab-b9fd-93ea5c13a109-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.268737 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.268703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2psd\" (UniqueName: \"kubernetes.io/projected/da379d96-ca41-47ab-b9fd-93ea5c13a109-kube-api-access-j2psd\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.268737 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.268740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da379d96-ca41-47ab-b9fd-93ea5c13a109-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.269016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.268761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.269016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.268780 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.269016 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:47:07.268887 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 17 13:47:07.269016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.268895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.269016 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:47:07.268974 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls podName:da379d96-ca41-47ab-b9fd-93ea5c13a109 nodeName:}" failed. No retries permitted until 2026-07-17 13:47:07.768950514 +0000 UTC m=+1697.437486243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls") pod "feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" (UID: "da379d96-ca41-47ab-b9fd-93ea5c13a109") : secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 17 13:47:07.269016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.268997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/da379d96-ca41-47ab-b9fd-93ea5c13a109-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.269363 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.269210 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da379d96-ca41-47ab-b9fd-93ea5c13a109-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.269644 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.269627 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/da379d96-ca41-47ab-b9fd-93ea5c13a109-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.271306 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.271287 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.271402 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.271342 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.276782 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.276760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2psd\" (UniqueName: \"kubernetes.io/projected/da379d96-ca41-47ab-b9fd-93ea5c13a109-kube-api-access-j2psd\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.774480 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.774442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:07.776859 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:07.776838 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:08.008201 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:08.008159 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:08.146733 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:08.146702 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc"] Jul 17 13:47:08.148755 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:47:08.148726 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda379d96_ca41_47ab_b9fd_93ea5c13a109.slice/crio-db42df8b2885f0637a441427d55ad974f7cd59c56517a0b5a73ff831d86aea4e WatchSource:0}: Error finding container db42df8b2885f0637a441427d55ad974f7cd59c56517a0b5a73ff831d86aea4e: Status 404 returned error can't find the container with id db42df8b2885f0637a441427d55ad974f7cd59c56517a0b5a73ff831d86aea4e Jul 17 13:47:08.666526 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:08.666490 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerStarted","Data":"bfe997ab1fa43a21e792ca4481797ff1979d11a33d33b763e393e477b909e7bb"} Jul 17 13:47:08.666726 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:08.666546 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerStarted","Data":"db42df8b2885f0637a441427d55ad974f7cd59c56517a0b5a73ff831d86aea4e"} Jul 17 13:47:13.687726 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:13.687641 2582 generic.go:356] "Generic (PLEG): container finished" podID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerID="bfe997ab1fa43a21e792ca4481797ff1979d11a33d33b763e393e477b909e7bb" exitCode=0 Jul 17 13:47:13.688094 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:13.687719 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerDied","Data":"bfe997ab1fa43a21e792ca4481797ff1979d11a33d33b763e393e477b909e7bb"} Jul 17 13:47:14.693368 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:14.693327 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerStarted","Data":"3a8197df44688a18204b3934252c840c71e848d80f633456ef89899596e3d305"} Jul 17 13:47:19.722036 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:19.722001 2582 generic.go:356] "Generic (PLEG): container finished" podID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerID="3a8197df44688a18204b3934252c840c71e848d80f633456ef89899596e3d305" exitCode=0 Jul 17 13:47:19.722446 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:19.722084 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerDied","Data":"3a8197df44688a18204b3934252c840c71e848d80f633456ef89899596e3d305"} Jul 17 13:47:20.731487 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:20.731454 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerStarted","Data":"106c5796fe7dab25c99b5e656af029cb523aec47dd51c0da30b20b1eb05733d9"} Jul 17 13:47:20.731985 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:20.731500 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerStarted","Data":"a9489e63633d809b66a42cbfa72ba83efad280955e5ed2650e650ce56d4db1a2"} Jul 17 13:47:20.731985 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:20.731514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerStarted","Data":"eff840d0124c2a5d83e738613de1d24c3d82ac07f5203cda9504180f7fb21c8c"} Jul 17 13:47:20.753265 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:20.753188 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podStartSLOduration=13.753165442 podStartE2EDuration="13.753165442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:47:20.751458679 +0000 UTC m=+1710.419994498" watchObservedRunningTime="2026-07-17 13:47:20.753165442 +0000 UTC m=+1710.421701183" Jul 17 13:47:23.008577 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:23.008535 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:23.009260 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:23.009238 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:23.009345 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:23.009268 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:23.010346 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:23.010303 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Jul 17 13:47:23.010346 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:23.010318 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused" Jul 17 13:47:23.010346 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:23.010341 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 13:47:26.008877 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:26.008827 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Jul 17 13:47:26.009686 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:26.009664 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:26.010040 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:26.010019 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:26.010447 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:26.010428 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:26.016289 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:26.016261 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:26.761609 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:26.761579 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:26.766095 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:26.766064 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:28.008365 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:28.008325 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:29.009408 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:29.009369 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:47:29.774825 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:47:29.774796 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:48:32.046916 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.046878 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc"] Jul 17 13:48:32.047546 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.047476 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" containerID="cri-o://eff840d0124c2a5d83e738613de1d24c3d82ac07f5203cda9504180f7fb21c8c" gracePeriod=30 Jul 17 13:48:32.047629 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.047521 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="offline" containerID="cri-o://a9489e63633d809b66a42cbfa72ba83efad280955e5ed2650e650ce56d4db1a2" gracePeriod=30 Jul 17 13:48:32.047629 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.047484 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" containerID="cri-o://106c5796fe7dab25c99b5e656af029cb523aec47dd51c0da30b20b1eb05733d9" gracePeriod=30 Jul 17 13:48:32.194979 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.194897 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44"] Jul 17 13:48:32.195320 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.195267 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="registry" containerID="cri-o://a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9" gracePeriod=30 Jul 17 13:48:32.195465 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.195315 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" containerID="cri-o://f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94" gracePeriod=30 Jul 17 13:48:32.195465 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.195322 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" containerID="cri-o://9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305" gracePeriod=30 Jul 17 13:48:32.195587 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:32.195317 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="offline" containerID="cri-o://50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24" gracePeriod=30 Jul 17 13:48:33.023067 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.023034 2582 generic.go:356] "Generic (PLEG): container finished" podID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerID="f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94" exitCode=0 Jul 17 13:48:33.023067 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.023060 2582 generic.go:356] "Generic (PLEG): container finished" podID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerID="9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305" exitCode=0 Jul 17 13:48:33.023335 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.023114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerDied","Data":"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94"} Jul 17 13:48:33.023335 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.023181 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerDied","Data":"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305"} Jul 17 13:48:33.025743 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.025720 2582 generic.go:356] "Generic (PLEG): container finished" podID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerID="106c5796fe7dab25c99b5e656af029cb523aec47dd51c0da30b20b1eb05733d9" exitCode=0 Jul 17 13:48:33.025743 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.025741 2582 generic.go:356] "Generic (PLEG): container finished" podID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerID="eff840d0124c2a5d83e738613de1d24c3d82ac07f5203cda9504180f7fb21c8c" exitCode=0 Jul 17 13:48:33.025890 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.025794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerDied","Data":"106c5796fe7dab25c99b5e656af029cb523aec47dd51c0da30b20b1eb05733d9"} Jul 17 13:48:33.025890 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:33.025830 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerDied","Data":"eff840d0124c2a5d83e738613de1d24c3d82ac07f5203cda9504180f7fb21c8c"} Jul 17 13:48:34.417369 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:34.417326 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Jul 17 13:48:36.761926 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:36.761883 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 13:48:39.775394 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:39.775347 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Jul 17 13:48:41.406180 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:41.406126 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 13:48:44.417631 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:44.417542 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Jul 17 13:48:46.761986 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:46.761947 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 13:48:49.774563 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:49.774519 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Jul 17 13:48:51.353490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:51.353449 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:48:51.356295 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:51.356272 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:48:51.358102 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:51.358077 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:48:51.360891 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:51.360872 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:48:51.406207 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:51.406167 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 13:48:54.417395 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:54.417355 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Jul 17 13:48:54.417870 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:54.417468 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:48:56.762082 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:56.762028 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 13:48:56.762586 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:56.762227 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:48:59.774953 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:59.774896 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Jul 17 13:48:59.775552 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:48:59.775041 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:49:01.406497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:01.406457 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 13:49:01.406871 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:01.406585 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:49:02.141566 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.141533 2582 generic.go:356] "Generic (PLEG): container finished" podID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerID="a9489e63633d809b66a42cbfa72ba83efad280955e5ed2650e650ce56d4db1a2" exitCode=137 Jul 17 13:49:02.141738 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.141584 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerDied","Data":"a9489e63633d809b66a42cbfa72ba83efad280955e5ed2650e650ce56d4db1a2"} Jul 17 13:49:02.700537 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.700511 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:49:02.746445 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.746409 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da379d96-ca41-47ab-b9fd-93ea5c13a109-feast-data\") pod \"da379d96-ca41-47ab-b9fd-93ea5c13a109\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " Jul 17 13:49:02.746639 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.746474 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2psd\" (UniqueName: \"kubernetes.io/projected/da379d96-ca41-47ab-b9fd-93ea5c13a109-kube-api-access-j2psd\") pod \"da379d96-ca41-47ab-b9fd-93ea5c13a109\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " Jul 17 13:49:02.746639 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.746516 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls\") pod \"da379d96-ca41-47ab-b9fd-93ea5c13a109\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " Jul 17 13:49:02.746639 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.746534 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-online-tls\") pod \"da379d96-ca41-47ab-b9fd-93ea5c13a109\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " Jul 17 13:49:02.746639 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.746592 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-ui-tls\") pod \"da379d96-ca41-47ab-b9fd-93ea5c13a109\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " Jul 17 13:49:02.746639 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.746621 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/da379d96-ca41-47ab-b9fd-93ea5c13a109-registry-tls\") pod \"da379d96-ca41-47ab-b9fd-93ea5c13a109\" (UID: \"da379d96-ca41-47ab-b9fd-93ea5c13a109\") " Jul 17 13:49:02.746983 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.746942 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da379d96-ca41-47ab-b9fd-93ea5c13a109-feast-data" (OuterVolumeSpecName: "feast-data") pod "da379d96-ca41-47ab-b9fd-93ea5c13a109" (UID: "da379d96-ca41-47ab-b9fd-93ea5c13a109"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:49:02.747525 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.747477 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da379d96-ca41-47ab-b9fd-93ea5c13a109-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "da379d96-ca41-47ab-b9fd-93ea5c13a109" (UID: "da379d96-ca41-47ab-b9fd-93ea5c13a109"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:49:02.749134 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.749102 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-online-tls" (OuterVolumeSpecName: "online-tls") pod "da379d96-ca41-47ab-b9fd-93ea5c13a109" (UID: "da379d96-ca41-47ab-b9fd-93ea5c13a109"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:49:02.749264 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.749126 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "da379d96-ca41-47ab-b9fd-93ea5c13a109" (UID: "da379d96-ca41-47ab-b9fd-93ea5c13a109"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:49:02.749324 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.749294 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "da379d96-ca41-47ab-b9fd-93ea5c13a109" (UID: "da379d96-ca41-47ab-b9fd-93ea5c13a109"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:49:02.749378 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.749349 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da379d96-ca41-47ab-b9fd-93ea5c13a109-kube-api-access-j2psd" (OuterVolumeSpecName: "kube-api-access-j2psd") pod "da379d96-ca41-47ab-b9fd-93ea5c13a109" (UID: "da379d96-ca41-47ab-b9fd-93ea5c13a109"). InnerVolumeSpecName "kube-api-access-j2psd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:49:02.847240 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.847216 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-ui-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:02.847240 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.847237 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/da379d96-ca41-47ab-b9fd-93ea5c13a109-registry-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:02.847428 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.847252 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da379d96-ca41-47ab-b9fd-93ea5c13a109-feast-data\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:02.847428 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.847264 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2psd\" (UniqueName: \"kubernetes.io/projected/da379d96-ca41-47ab-b9fd-93ea5c13a109-kube-api-access-j2psd\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:02.847428 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.847278 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-offline-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:02.847428 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.847316 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da379d96-ca41-47ab-b9fd-93ea5c13a109-online-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:02.850701 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.850682 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:49:02.948364 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.948325 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls\") pod \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " Jul 17 13:49:02.948561 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.948380 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-online-tls\") pod \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " Jul 17 13:49:02.948561 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.948419 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-offline-tls\") pod \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " Jul 17 13:49:02.948561 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.948516 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/773a6eaf-0175-4d66-a0fb-3aba21f4c097-feast-data\") pod \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " Jul 17 13:49:02.948734 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.948576 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls\") pod \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " Jul 17 13:49:02.948734 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.948608 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcshm\" (UniqueName: \"kubernetes.io/projected/773a6eaf-0175-4d66-a0fb-3aba21f4c097-kube-api-access-bcshm\") pod \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\" (UID: \"773a6eaf-0175-4d66-a0fb-3aba21f4c097\") " Jul 17 13:49:02.949099 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.949064 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773a6eaf-0175-4d66-a0fb-3aba21f4c097-feast-data" (OuterVolumeSpecName: "feast-data") pod "773a6eaf-0175-4d66-a0fb-3aba21f4c097" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:49:02.950735 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.950712 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773a6eaf-0175-4d66-a0fb-3aba21f4c097-kube-api-access-bcshm" (OuterVolumeSpecName: "kube-api-access-bcshm") pod "773a6eaf-0175-4d66-a0fb-3aba21f4c097" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097"). InnerVolumeSpecName "kube-api-access-bcshm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:49:02.951072 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.951046 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "773a6eaf-0175-4d66-a0fb-3aba21f4c097" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:49:02.951072 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.951058 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "773a6eaf-0175-4d66-a0fb-3aba21f4c097" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:49:02.951232 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.951080 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "773a6eaf-0175-4d66-a0fb-3aba21f4c097" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:49:02.951232 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:02.951091 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-online-tls" (OuterVolumeSpecName: "online-tls") pod "773a6eaf-0175-4d66-a0fb-3aba21f4c097" (UID: "773a6eaf-0175-4d66-a0fb-3aba21f4c097"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:49:03.049512 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.049461 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-ui-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:03.049512 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.049505 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcshm\" (UniqueName: \"kubernetes.io/projected/773a6eaf-0175-4d66-a0fb-3aba21f4c097-kube-api-access-bcshm\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:03.049512 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.049516 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-registry-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:03.049512 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.049526 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-online-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:03.049512 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.049534 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/773a6eaf-0175-4d66-a0fb-3aba21f4c097-offline-tls\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:03.049829 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.049541 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/773a6eaf-0175-4d66-a0fb-3aba21f4c097-feast-data\") on node \"ip-10-0-132-223.ec2.internal\" DevicePath \"\"" Jul 17 13:49:03.148426 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.148334 2582 generic.go:356] "Generic (PLEG): container finished" podID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerID="50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24" exitCode=137 Jul 17 13:49:03.148426 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.148367 2582 generic.go:356] "Generic (PLEG): container finished" podID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerID="a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9" exitCode=137 Jul 17 13:49:03.148426 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.148400 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" Jul 17 13:49:03.148426 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.148403 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerDied","Data":"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24"} Jul 17 13:49:03.148716 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.148451 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerDied","Data":"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9"} Jul 17 13:49:03.148716 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.148466 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44" event={"ID":"773a6eaf-0175-4d66-a0fb-3aba21f4c097","Type":"ContainerDied","Data":"185b1e916f5eeee36251f476981ff9622ec58967cd405f59b5b8106daeeb752a"} Jul 17 13:49:03.148716 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.148483 2582 scope.go:117] "RemoveContainer" containerID="f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94" Jul 17 13:49:03.151227 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.151209 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" Jul 17 13:49:03.151227 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.151217 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc" event={"ID":"da379d96-ca41-47ab-b9fd-93ea5c13a109","Type":"ContainerDied","Data":"db42df8b2885f0637a441427d55ad974f7cd59c56517a0b5a73ff831d86aea4e"} Jul 17 13:49:03.159045 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.159026 2582 scope.go:117] "RemoveContainer" containerID="50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24" Jul 17 13:49:03.166702 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.166677 2582 scope.go:117] "RemoveContainer" containerID="9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305" Jul 17 13:49:03.168079 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.168060 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc"] Jul 17 13:49:03.172097 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.172070 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-mcqbc"] Jul 17 13:49:03.174823 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.174809 2582 scope.go:117] "RemoveContainer" containerID="a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9" Jul 17 13:49:03.181967 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.181951 2582 scope.go:117] "RemoveContainer" containerID="b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11" Jul 17 13:49:03.182021 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.181989 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44"] Jul 17 13:49:03.185532 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.185513 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jpq44"] Jul 17 13:49:03.189728 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.189711 2582 scope.go:117] "RemoveContainer" containerID="80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f" Jul 17 13:49:03.197122 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.197099 2582 scope.go:117] "RemoveContainer" containerID="f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94" Jul 17 13:49:03.197469 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:49:03.197444 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94\": container with ID starting with f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94 not found: ID does not exist" containerID="f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94" Jul 17 13:49:03.197520 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.197481 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94"} err="failed to get container status \"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94\": rpc error: code = NotFound desc = could not find container \"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94\": container with ID starting with f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94 not found: ID does not exist" Jul 17 13:49:03.197520 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.197507 2582 scope.go:117] "RemoveContainer" containerID="50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24" Jul 17 13:49:03.197739 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:49:03.197719 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24\": container with ID starting with 50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24 not found: ID does not exist" containerID="50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24" Jul 17 13:49:03.197786 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.197744 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24"} err="failed to get container status \"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24\": rpc error: code = NotFound desc = could not find container \"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24\": container with ID starting with 50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24 not found: ID does not exist" Jul 17 13:49:03.197786 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.197760 2582 scope.go:117] "RemoveContainer" containerID="9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305" Jul 17 13:49:03.197993 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:49:03.197978 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305\": container with ID starting with 9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305 not found: ID does not exist" containerID="9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305" Jul 17 13:49:03.198050 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.197995 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305"} err="failed to get container status \"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305\": rpc error: code = NotFound desc = could not find container \"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305\": container with ID starting with 9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305 not found: ID does not exist" Jul 17 13:49:03.198050 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198006 2582 scope.go:117] "RemoveContainer" containerID="a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9" Jul 17 13:49:03.198247 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:49:03.198228 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9\": container with ID starting with a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9 not found: ID does not exist" containerID="a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9" Jul 17 13:49:03.198323 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198259 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9"} err="failed to get container status \"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9\": rpc error: code = NotFound desc = could not find container \"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9\": container with ID starting with a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9 not found: ID does not exist" Jul 17 13:49:03.198323 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198280 2582 scope.go:117] "RemoveContainer" containerID="b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11" Jul 17 13:49:03.198514 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:49:03.198497 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11\": container with ID starting with b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11 not found: ID does not exist" containerID="b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11" Jul 17 13:49:03.198569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198521 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11"} err="failed to get container status \"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11\": rpc error: code = NotFound desc = could not find container \"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11\": container with ID starting with b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11 not found: ID does not exist" Jul 17 13:49:03.198569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198539 2582 scope.go:117] "RemoveContainer" containerID="80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f" Jul 17 13:49:03.198739 ip-10-0-132-223 kubenswrapper[2582]: E0717 13:49:03.198723 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f\": container with ID starting with 80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f not found: ID does not exist" containerID="80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f" Jul 17 13:49:03.198781 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198743 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f"} err="failed to get container status \"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f\": rpc error: code = NotFound desc = could not find container \"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f\": container with ID starting with 80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f not found: ID does not exist" Jul 17 13:49:03.198781 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198758 2582 scope.go:117] "RemoveContainer" containerID="f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94" Jul 17 13:49:03.198948 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198933 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94"} err="failed to get container status \"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94\": rpc error: code = NotFound desc = could not find container \"f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94\": container with ID starting with f2a039494e714b6be4e84affc37e14678e75674af82b0270adcfdac2a86d0c94 not found: ID does not exist" Jul 17 13:49:03.198948 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.198948 2582 scope.go:117] "RemoveContainer" containerID="50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24" Jul 17 13:49:03.199180 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199158 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24"} err="failed to get container status \"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24\": rpc error: code = NotFound desc = could not find container \"50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24\": container with ID starting with 50d415fd43adf54158c85e49b5cb87b56a7b74658cae1c660e878a08aa56fc24 not found: ID does not exist" Jul 17 13:49:03.199180 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199180 2582 scope.go:117] "RemoveContainer" containerID="9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305" Jul 17 13:49:03.199397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199380 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305"} err="failed to get container status \"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305\": rpc error: code = NotFound desc = could not find container \"9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305\": container with ID starting with 9a29cbb60cd0069a60e1c5e9ee4dee119bdb141621d4e16c8de51e17389bc305 not found: ID does not exist" Jul 17 13:49:03.199397 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199395 2582 scope.go:117] "RemoveContainer" containerID="a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9" Jul 17 13:49:03.199577 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199562 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9"} err="failed to get container status \"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9\": rpc error: code = NotFound desc = could not find container \"a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9\": container with ID starting with a852087c48af140c5cea32c755d5b3c48b3c8741af39650095c5fbdeccb4dee9 not found: ID does not exist" Jul 17 13:49:03.199619 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199579 2582 scope.go:117] "RemoveContainer" containerID="b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11" Jul 17 13:49:03.199761 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199740 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11"} err="failed to get container status \"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11\": rpc error: code = NotFound desc = could not find container \"b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11\": container with ID starting with b99f2eef1f3638e1a66d9d1d827dcdc492867ec362471199b469da949482ae11 not found: ID does not exist" Jul 17 13:49:03.199810 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199763 2582 scope.go:117] "RemoveContainer" containerID="80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f" Jul 17 13:49:03.199993 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199972 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f"} err="failed to get container status \"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f\": rpc error: code = NotFound desc = could not find container \"80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f\": container with ID starting with 80d9fc854aa8983b80d57671ccbea8a5a2e0dd34209f87e925b503ed512e505f not found: ID does not exist" Jul 17 13:49:03.200044 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.199995 2582 scope.go:117] "RemoveContainer" containerID="106c5796fe7dab25c99b5e656af029cb523aec47dd51c0da30b20b1eb05733d9" Jul 17 13:49:03.207569 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.207554 2582 scope.go:117] "RemoveContainer" containerID="a9489e63633d809b66a42cbfa72ba83efad280955e5ed2650e650ce56d4db1a2" Jul 17 13:49:03.214562 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.214545 2582 scope.go:117] "RemoveContainer" containerID="eff840d0124c2a5d83e738613de1d24c3d82ac07f5203cda9504180f7fb21c8c" Jul 17 13:49:03.221539 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.221521 2582 scope.go:117] "RemoveContainer" containerID="3a8197df44688a18204b3934252c840c71e848d80f633456ef89899596e3d305" Jul 17 13:49:03.228119 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:03.228103 2582 scope.go:117] "RemoveContainer" containerID="bfe997ab1fa43a21e792ca4481797ff1979d11a33d33b763e393e477b909e7bb" Jul 17 13:49:04.847910 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:04.847862 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" path="/var/lib/kubelet/pods/773a6eaf-0175-4d66-a0fb-3aba21f4c097/volumes" Jul 17 13:49:04.848697 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:04.848673 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" path="/var/lib/kubelet/pods/da379d96-ca41-47ab-b9fd-93ea5c13a109/volumes" Jul 17 13:49:38.775593 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775551 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n4gdz/must-gather-glhwr"] Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775842 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="feast-apply" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775853 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="feast-apply" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775873 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="feast-apply" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775879 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="feast-apply" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775886 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775892 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775898 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="offline" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775904 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="offline" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775910 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775915 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775926 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="feast-init" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775932 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="feast-init" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775939 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775946 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775952 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="registry" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775959 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="registry" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775965 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="feast-init" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775970 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="feast-init" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775981 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="offline" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775986 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="offline" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775992 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.775998 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.776070 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="online" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.776083 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="online" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.776094 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="offline" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.776100 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="ui" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.776106 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da379d96-ca41-47ab-b9fd-93ea5c13a109" containerName="ui" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.776111 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="registry" Jul 17 13:49:38.776112 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.776118 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="773a6eaf-0175-4d66-a0fb-3aba21f4c097" containerName="offline" Jul 17 13:49:38.779305 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.779279 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:38.781553 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.781525 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n4gdz\"/\"kube-root-ca.crt\"" Jul 17 13:49:38.782371 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.782346 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n4gdz\"/\"openshift-service-ca.crt\"" Jul 17 13:49:38.782490 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.782376 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n4gdz\"/\"default-dockercfg-ztd6p\"" Jul 17 13:49:38.785887 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.785854 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4gdz/must-gather-glhwr"] Jul 17 13:49:38.839343 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.839301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5-must-gather-output\") pod \"must-gather-glhwr\" (UID: \"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5\") " pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:38.839343 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.839344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2s9s\" (UniqueName: \"kubernetes.io/projected/7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5-kube-api-access-c2s9s\") pod \"must-gather-glhwr\" (UID: \"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5\") " pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:38.940089 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.940044 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5-must-gather-output\") pod \"must-gather-glhwr\" (UID: \"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5\") " pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:38.940302 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.940109 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2s9s\" (UniqueName: \"kubernetes.io/projected/7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5-kube-api-access-c2s9s\") pod \"must-gather-glhwr\" (UID: \"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5\") " pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:38.940483 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.940463 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5-must-gather-output\") pod \"must-gather-glhwr\" (UID: \"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5\") " pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:38.949204 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:38.949141 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2s9s\" (UniqueName: \"kubernetes.io/projected/7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5-kube-api-access-c2s9s\") pod \"must-gather-glhwr\" (UID: \"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5\") " pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:39.100661 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:39.100617 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4gdz/must-gather-glhwr" Jul 17 13:49:39.239390 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:39.239345 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4gdz/must-gather-glhwr"] Jul 17 13:49:39.241955 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:49:39.241912 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ae7d9d1_73ca_4d74_bb0a_0ee4db8eb5a5.slice/crio-f6f314fae48d93e2fb05a8593489122c3dabbc5379b27939680cece984867fda WatchSource:0}: Error finding container f6f314fae48d93e2fb05a8593489122c3dabbc5379b27939680cece984867fda: Status 404 returned error can't find the container with id f6f314fae48d93e2fb05a8593489122c3dabbc5379b27939680cece984867fda Jul 17 13:49:39.244000 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:39.243980 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:49:39.284065 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:39.284020 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4gdz/must-gather-glhwr" event={"ID":"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5","Type":"ContainerStarted","Data":"f6f314fae48d93e2fb05a8593489122c3dabbc5379b27939680cece984867fda"} Jul 17 13:49:40.290356 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:40.290267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4gdz/must-gather-glhwr" event={"ID":"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5","Type":"ContainerStarted","Data":"03b4ec5402b94f3bce3bfa4f037c013ea300b1b1afc2370753b7c5521ebed006"} Jul 17 13:49:40.290356 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:40.290321 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4gdz/must-gather-glhwr" event={"ID":"7ae7d9d1-73ca-4d74-bb0a-0ee4db8eb5a5","Type":"ContainerStarted","Data":"1d7bcb83b75bce49578b4e32fba734d0256d312ad1c99773694e764b55288f4e"} Jul 17 13:49:40.304873 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:40.304807 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n4gdz/must-gather-glhwr" podStartSLOduration=1.517149286 podStartE2EDuration="2.304786349s" totalImagesPullingTime="787.637063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:49:40.30321057 +0000 UTC m=+1849.971746312" watchObservedRunningTime="2026-07-17 13:49:40.304786349 +0000 UTC m=+1849.973322106" Jul 17 13:49:41.432651 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:41.432620 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vm9wl_4c0ff472-2456-4cbb-a738-644225307091/global-pull-secret-syncer/0.log" Jul 17 13:49:41.536626 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:41.536592 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8dwh9_aa553e18-e0f0-4b20-928c-5b5418df0331/konnectivity-agent/0.log" Jul 17 13:49:41.557096 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:41.557068 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-223.ec2.internal_a444e4281a1962a7ac9260c67faa733a/haproxy/0.log" Jul 17 13:49:45.517484 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:45.517444 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-b27ht_5d43d692-c2ac-4628-8a59-2b56a5302470/cluster-monitoring-operator/0.log" Jul 17 13:49:45.839503 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:45.839457 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9prth_dc5584c2-49d0-4c19-9eb7-fd8dbc897127/node-exporter/0.log" Jul 17 13:49:45.858944 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:45.858916 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9prth_dc5584c2-49d0-4c19-9eb7-fd8dbc897127/kube-rbac-proxy/0.log" Jul 17 13:49:45.879497 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:45.879402 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9prth_dc5584c2-49d0-4c19-9eb7-fd8dbc897127/init-textfile/0.log" Jul 17 13:49:47.700945 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:47.700913 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-tbsxl_b9c29254-f182-4a01-9147-5dd4f8d0db7f/networking-console-plugin/0.log" Jul 17 13:49:48.150796 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.150762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/1.log" Jul 17 13:49:48.156863 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.156792 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6dlvv_e81918e8-0a9d-4880-88c3-8df0794e9b83/console-operator/2.log" Jul 17 13:49:48.516328 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.516244 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d949b6f5f-hdf8w_58128ae7-2139-43b4-bc9a-0b9d2165efcf/console/0.log" Jul 17 13:49:48.548448 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.548413 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-824ps_2d140957-1e08-4d8a-bbfb-8cdeaee9ae33/download-server/0.log" Jul 17 13:49:48.756188 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.756131 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh"] Jul 17 13:49:48.762117 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.762088 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.769306 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.769249 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh"] Jul 17 13:49:48.823018 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.822977 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-sys\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.823206 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.823037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-podres\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.823206 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.823104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-lib-modules\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.823206 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.823181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-proc\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.823329 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.823216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcl74\" (UniqueName: \"kubernetes.io/projected/979c53f1-4e6d-40c1-80eb-30fd23174cab-kube-api-access-mcl74\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.924713 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.924666 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-sys\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.924927 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.924729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-podres\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.924927 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.924799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-lib-modules\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.924927 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.924848 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-proc\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.924927 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.924887 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcl74\" (UniqueName: \"kubernetes.io/projected/979c53f1-4e6d-40c1-80eb-30fd23174cab-kube-api-access-mcl74\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.925352 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.925322 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-sys\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.925485 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.925464 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-podres\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.925585 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.925568 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-lib-modules\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.925727 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.925619 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/979c53f1-4e6d-40c1-80eb-30fd23174cab-proc\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:48.932732 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:48.932700 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcl74\" (UniqueName: \"kubernetes.io/projected/979c53f1-4e6d-40c1-80eb-30fd23174cab-kube-api-access-mcl74\") pod \"perf-node-gather-daemonset-wlcdh\" (UID: \"979c53f1-4e6d-40c1-80eb-30fd23174cab\") " pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:49.051089 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:49.051058 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-qdpdv_cb402625-b5b1-41db-91f2-82f6c16e7624/volume-data-source-validator/0.log" Jul 17 13:49:49.075126 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:49.075082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:49.236332 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:49.236296 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh"] Jul 17 13:49:49.239946 ip-10-0-132-223 kubenswrapper[2582]: W0717 13:49:49.239911 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod979c53f1_4e6d_40c1_80eb_30fd23174cab.slice/crio-883d80e7f189e19d418b1c225489f5efe235431fe66be0fc1a350696f8d7dd3c WatchSource:0}: Error finding container 883d80e7f189e19d418b1c225489f5efe235431fe66be0fc1a350696f8d7dd3c: Status 404 returned error can't find the container with id 883d80e7f189e19d418b1c225489f5efe235431fe66be0fc1a350696f8d7dd3c Jul 17 13:49:49.336081 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:49.335943 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" event={"ID":"979c53f1-4e6d-40c1-80eb-30fd23174cab","Type":"ContainerStarted","Data":"883d80e7f189e19d418b1c225489f5efe235431fe66be0fc1a350696f8d7dd3c"} Jul 17 13:49:49.860050 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:49.859999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvltr_1f64b7fd-a0f7-4400-bda5-e0ab4c51454d/dns/0.log" Jul 17 13:49:49.878343 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:49.878315 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvltr_1f64b7fd-a0f7-4400-bda5-e0ab4c51454d/kube-rbac-proxy/0.log" Jul 17 13:49:49.948681 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:49.948655 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stwzb_84451f7e-4e57-4d73-8886-4ab6ae55c489/dns-node-resolver/0.log" Jul 17 13:49:50.342717 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:50.342668 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" event={"ID":"979c53f1-4e6d-40c1-80eb-30fd23174cab","Type":"ContainerStarted","Data":"23d20f7aed60fc73b35a366628f87bf0422cb1fe750f5f7e4b9b4e65be969deb"} Jul 17 13:49:50.342956 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:50.342773 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:50.342956 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:50.342821 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pgkwb_8a0793a5-bee4-49aa-a461-97a58a7d5fc6/node-ca/0.log" Jul 17 13:49:50.356744 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:50.356696 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" podStartSLOduration=2.35668147 podStartE2EDuration="2.35668147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:49:50.356363444 +0000 UTC m=+1860.024899184" watchObservedRunningTime="2026-07-17 13:49:50.35668147 +0000 UTC m=+1860.025217232" Jul 17 13:49:51.065007 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:51.064972 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c49788448-6b6gk_21fdc76d-8f78-499a-8b61-cbe8b58c0662/router/0.log" Jul 17 13:49:51.393109 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:51.393069 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xhh4d_9ef98409-7867-4e27-afe1-3ecf63eb712a/serve-healthcheck-canary/0.log" Jul 17 13:49:51.719882 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:51.719774 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xh8tg_e05af3b4-0faf-488f-b5ac-83799bb0f7b6/insights-operator/0.log" Jul 17 13:49:51.720538 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:51.720511 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xh8tg_e05af3b4-0faf-488f-b5ac-83799bb0f7b6/insights-operator/1.log" Jul 17 13:49:51.859434 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:51.859404 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjvfq_cd11e2ea-c0ff-4122-ae0c-a330c9f21a50/kube-rbac-proxy/0.log" Jul 17 13:49:51.877442 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:51.877411 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjvfq_cd11e2ea-c0ff-4122-ae0c-a330c9f21a50/exporter/0.log" Jul 17 13:49:51.896140 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:51.896104 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjvfq_cd11e2ea-c0ff-4122-ae0c-a330c9f21a50/extractor/0.log" Jul 17 13:49:56.087079 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:56.087042 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-mdnqp_ae5e6775-6604-4030-8396-ac3b91852cdb/kube-storage-version-migrator-operator/1.log" Jul 17 13:49:56.088016 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:56.087991 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-mdnqp_ae5e6775-6604-4030-8396-ac3b91852cdb/kube-storage-version-migrator-operator/0.log" Jul 17 13:49:56.358832 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:56.358756 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n4gdz/perf-node-gather-daemonset-wlcdh" Jul 17 13:49:56.945536 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:56.945507 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-99w2m_ebb877da-9edc-4334-bf13-cf3baff2516f/kube-multus/0.log" Jul 17 13:49:57.274267 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.274090 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzln6_1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be/kube-multus-additional-cni-plugins/0.log" Jul 17 13:49:57.297095 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.297069 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzln6_1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be/egress-router-binary-copy/0.log" Jul 17 13:49:57.318531 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.318503 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzln6_1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be/cni-plugins/0.log" Jul 17 13:49:57.340822 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.340795 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzln6_1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be/bond-cni-plugin/0.log" Jul 17 13:49:57.366749 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.366722 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzln6_1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be/routeoverride-cni/0.log" Jul 17 13:49:57.388424 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.388399 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzln6_1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be/whereabouts-cni-bincopy/0.log" Jul 17 13:49:57.410124 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.410094 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzln6_1b6c1ce6-b0cb-48cb-b2e1-32cc96cfe7be/whereabouts-cni/0.log" Jul 17 13:49:57.572862 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.572828 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wmxh4_f8ca89ae-7469-4635-b5d0-01f124a55d7a/network-metrics-daemon/0.log" Jul 17 13:49:57.592496 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:57.592469 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wmxh4_f8ca89ae-7469-4635-b5d0-01f124a55d7a/kube-rbac-proxy/0.log" Jul 17 13:49:58.610065 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.610033 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-controller/0.log" Jul 17 13:49:58.626059 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.626029 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/1.log" Jul 17 13:49:58.626225 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.626103 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovn-acl-logging/0.log" Jul 17 13:49:58.642942 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.642913 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/kube-rbac-proxy-node/0.log" Jul 17 13:49:58.661903 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.661875 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 13:49:58.679122 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.679106 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/northd/0.log" Jul 17 13:49:58.697946 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.697893 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/nbdb/0.log" Jul 17 13:49:58.716797 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.716774 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/sbdb/0.log" Jul 17 13:49:58.759576 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:58.759543 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2js58_0ee56a7e-cf4e-4223-9840-f1799df0d9ac/ovnkube-controller/0.log" Jul 17 13:49:59.967920 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:49:59.967844 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-w9h89_b3383f8a-6a4f-4a16-8b65-a146e512f812/check-endpoints/0.log" Jul 17 13:50:00.035229 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:00.035192 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-s62bj_c3f212e0-b175-4de3-9f0e-fb1139d3afe0/network-check-target-container/0.log" Jul 17 13:50:00.826726 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:00.826700 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cqwxv_c3dc8168-45aa-40fe-a855-69ce3f723bf8/iptables-alerter/0.log" Jul 17 13:50:01.454339 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:01.454290 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-fc4vm_92392aee-1962-4a2a-9e4e-c08db14444df/tuned/0.log" Jul 17 13:50:03.122099 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:03.122067 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-5cfpl_9be16b4f-5ee9-4e1f-b450-5c219c3b10f9/cluster-samples-operator/0.log" Jul 17 13:50:03.136800 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:03.136771 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-5cfpl_9be16b4f-5ee9-4e1f-b450-5c219c3b10f9/cluster-samples-operator-watch/0.log" Jul 17 13:50:03.994678 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:03.994649 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-4ht2h_6eeae02d-fa18-4f8e-b5de-b4e9d1098187/service-ca-operator/1.log" Jul 17 13:50:03.995955 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:03.995932 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-4ht2h_6eeae02d-fa18-4f8e-b5de-b4e9d1098187/service-ca-operator/0.log" Jul 17 13:50:04.684430 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:04.684401 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qlt27_e341155b-9499-42cd-8171-d2b4a85435e3/csi-driver/0.log" Jul 17 13:50:04.708443 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:04.708409 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qlt27_e341155b-9499-42cd-8171-d2b4a85435e3/csi-node-driver-registrar/0.log" Jul 17 13:50:04.729138 ip-10-0-132-223 kubenswrapper[2582]: I0717 13:50:04.729112 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qlt27_e341155b-9499-42cd-8171-d2b4a85435e3/csi-liveness-probe/0.log"