Jul 16 00:40:18.832341 ip-10-0-141-73 systemd[1]: Starting Kubernetes Kubelet... Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.231742 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235734 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235745 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235749 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235753 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235756 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235759 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235765 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:40:19.351818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235768 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:40:19.304694 ip-10-0-141-73 systemd[1]: Started Kubernetes Kubelet. Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235771 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235774 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235777 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235780 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235783 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235786 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235789 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235793 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235796 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235798 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235803 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235806 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235809 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235812 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235814 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235817 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235820 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235823 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235825 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:40:19.356921 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235828 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235830 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235833 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235836 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235838 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235841 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235843 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235846 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235849 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235851 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235854 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235857 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235859 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235862 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235864 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235867 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235869 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235872 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235874 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235877 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:40:19.357763 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235880 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235883 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235885 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235888 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235891 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235893 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235896 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235901 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235904 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235907 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235910 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235913 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235915 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235918 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235921 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235924 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235926 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235929 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235931 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235933 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:40:19.358422 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235936 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235939 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235941 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235943 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235946 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235948 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235951 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235953 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235956 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235958 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235962 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235966 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235969 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235973 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235975 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235978 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235980 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235983 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235985 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:40:19.359119 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235987 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235990 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235993 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235996 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.235998 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236001 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236004 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236006 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236009 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236011 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236014 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236016 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236018 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236772 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236778 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236782 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236785 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236788 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236791 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:40:19.359931 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236795 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236799 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236802 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236805 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236808 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236813 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236816 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236819 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236823 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236826 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236829 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236832 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236834 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236837 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236839 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236843 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236847 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236849 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236852 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236855 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:40:19.361080 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236858 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236860 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236863 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236865 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236868 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236870 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236873 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236875 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236878 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236881 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236884 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236887 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236889 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236892 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236894 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236897 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236900 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236903 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236906 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:40:19.362066 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236909 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236911 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236914 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236917 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236920 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236922 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236924 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236927 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236930 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236932 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236935 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236937 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236940 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236943 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236945 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236947 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236950 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236952 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236955 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236957 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:40:19.363101 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236960 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236962 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236965 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236968 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236970 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236973 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236975 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236979 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236981 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236984 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236986 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236990 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236995 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.236999 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237002 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237005 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237007 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237010 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237012 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237015 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:40:19.364125 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237018 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237020 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237023 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237025 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237028 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237054 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237057 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237059 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237062 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237065 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237067 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237070 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237073 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237076 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237472 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237477 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237480 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237485 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237488 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:40:19.365262 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237491 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237494 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237497 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237500 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237503 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237506 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237510 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237512 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237515 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237517 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237520 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237523 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237526 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237529 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237533 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237535 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237538 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237541 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237543 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237546 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:40:19.365778 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237549 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237552 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237554 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237557 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237559 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237564 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237567 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237570 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237573 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237576 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237578 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237581 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237583 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237586 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237589 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237591 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237594 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237597 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237600 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237603 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:40:19.366362 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237605 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237608 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237611 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237614 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237616 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237619 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237621 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237624 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237627 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237630 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237632 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237635 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237637 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237640 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237643 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237645 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237648 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237652 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237655 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:40:19.366948 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237657 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237660 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237662 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237665 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237667 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237670 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237672 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237675 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237677 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237680 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237683 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237686 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237690 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237692 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237695 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237697 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237700 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237702 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237705 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237707 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:40:19.370085 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237710 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237712 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237715 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237718 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237722 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237725 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237727 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237730 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237733 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237735 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237739 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237742 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237745 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237749 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.237752 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237825 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237832 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237839 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237843 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237847 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237850 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 00:40:19.371607 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237854 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237858 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237861 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237864 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237876 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237879 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237882 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237885 2572 flags.go:64] FLAG: --cgroup-root="" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237888 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237891 2572 flags.go:64] FLAG: --client-ca-file="" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237894 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237897 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237901 2572 flags.go:64] FLAG: --cluster-domain="" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237904 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237907 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237911 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237915 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237923 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237926 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237929 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237932 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237936 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237939 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237942 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 00:40:19.372395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237945 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237948 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237952 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237955 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237958 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237961 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237964 2572 flags.go:64] FLAG: --enable-server="true" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237967 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237971 2572 flags.go:64] FLAG: --event-burst="100" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237974 2572 flags.go:64] FLAG: --event-qps="50" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237977 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237980 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237983 2572 flags.go:64] FLAG: --eviction-hard="" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237988 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237990 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237993 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237996 2572 flags.go:64] FLAG: --eviction-soft="" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.237999 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238002 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238005 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238008 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238011 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238014 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238021 2572 flags.go:64] FLAG: --feature-gates="" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238025 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 00:40:19.372998 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238028 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238045 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238048 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238051 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238056 2572 flags.go:64] FLAG: --help="false" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238059 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-141-73.ec2.internal" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238062 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238065 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238068 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238071 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238074 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238077 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238080 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238083 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238086 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238089 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238092 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238094 2572 flags.go:64] FLAG: --kube-reserved="" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238097 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238100 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238103 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238106 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238109 2572 flags.go:64] FLAG: --lock-file="" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238112 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 00:40:21.679458 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238115 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238118 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238123 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238126 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238129 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238132 2572 flags.go:64] FLAG: --logging-format="text" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238136 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238139 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238142 2572 flags.go:64] FLAG: --manifest-url="" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238144 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238149 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238152 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238157 2572 flags.go:64] FLAG: --max-pods="110" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238161 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238164 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238167 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238170 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238173 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238176 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238179 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238186 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238189 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238192 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 00:40:21.704792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238195 2572 flags.go:64] FLAG: --pod-cidr="" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238198 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238204 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238207 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238210 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238213 2572 flags.go:64] FLAG: --port="10250" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238216 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238219 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a66e8c380d2e3faa" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238223 2572 flags.go:64] FLAG: --qos-reserved="" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238226 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238229 2572 flags.go:64] FLAG: --register-node="true" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238232 2572 flags.go:64] FLAG: --register-with-taints="" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238235 2572 flags.go:64] FLAG: --registry-burst="10" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238238 2572 flags.go:64] FLAG: --registry-qps="5" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238241 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238245 2572 flags.go:64] FLAG: --reserved-memory="" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238249 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238252 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238255 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238258 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238261 2572 flags.go:64] FLAG: --runonce="false" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238264 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238268 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238271 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238274 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 00:40:21.705626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238277 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238280 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238283 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238286 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238289 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238292 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238295 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238298 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238301 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238304 2572 flags.go:64] FLAG: --system-cgroups="" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238306 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238312 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238314 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238317 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238322 2572 flags.go:64] FLAG: --tls-min-version="" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238325 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238328 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238331 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238334 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238337 2572 flags.go:64] FLAG: --v="2" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238340 2572 flags.go:64] FLAG: --version="false" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238349 2572 flags.go:64] FLAG: --vmodule="" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238354 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238358 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 00:40:21.708312 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238472 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238477 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238480 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238483 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238486 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238490 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238493 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238496 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238500 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238503 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238507 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238510 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238513 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238516 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238519 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238521 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238524 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238526 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238529 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:40:21.709074 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238532 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238536 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238539 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238543 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238545 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238549 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238552 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238554 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238557 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238560 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238562 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238566 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238569 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238571 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238574 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238577 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238579 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238582 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238586 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238588 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:40:21.709709 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238591 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238593 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238596 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238599 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238602 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238604 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238607 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238609 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238612 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238615 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238617 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238620 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238622 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238625 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238627 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238630 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238632 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238635 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238638 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238641 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:40:21.710283 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238643 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238645 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238648 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238652 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238655 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238657 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238660 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238662 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238664 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238668 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238674 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238677 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238680 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238682 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238685 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238687 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238690 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238692 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238695 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238697 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:40:21.710982 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238700 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238703 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238705 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238708 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238710 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238713 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238715 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238718 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238720 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238723 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238726 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238735 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238738 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238741 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238743 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238747 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238750 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238752 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238755 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:40:21.711547 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.238757 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.238763 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.247081 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.247101 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.247115 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.247123 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247199 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247206 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247209 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247212 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247216 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247219 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247222 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247227 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:40:21.712696 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247231 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247234 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247237 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247239 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247242 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247245 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247247 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247250 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247253 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247256 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247258 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247261 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247263 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247266 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247268 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247271 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247273 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247276 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247279 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247281 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:40:21.713156 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247284 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247295 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247298 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247302 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247305 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247308 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247312 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247315 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247318 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247321 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247323 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247326 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247328 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247331 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247333 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247336 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247338 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247341 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247347 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:40:21.889502 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247350 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247353 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247355 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247358 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247360 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247363 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247365 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247368 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247371 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247373 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247376 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247378 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247381 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247383 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247386 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247394 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247397 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247400 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247402 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:40:21.890223 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247405 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247407 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247410 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247412 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247415 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247417 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247421 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247424 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247427 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247430 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247433 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247435 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247439 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247443 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247446 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247448 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247451 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247453 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247456 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247459 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:40:21.890818 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247461 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247464 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247466 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247469 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247471 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247474 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247477 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247479 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247482 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247491 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247494 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247496 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247499 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.247504 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247658 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:40:21.891866 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247663 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247666 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247669 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247672 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247674 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247677 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247680 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247682 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247685 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247688 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247695 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247698 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247701 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247704 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247707 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247710 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247713 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247716 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247719 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:40:21.892347 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247722 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247724 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247728 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247730 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247733 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247736 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247739 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247741 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247750 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247753 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247755 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247758 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247760 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247763 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247765 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247768 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247770 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247773 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247775 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247778 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:40:21.892898 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247780 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247782 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247785 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247791 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247793 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247796 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247798 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247801 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247803 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247806 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247808 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247811 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247813 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247816 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247818 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247821 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247823 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247826 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247829 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247832 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:40:21.893592 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247835 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247844 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247846 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247849 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247852 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247854 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247856 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247859 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247861 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247864 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247866 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247869 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247871 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247874 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247876 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247881 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247883 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247886 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247888 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:40:21.894198 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247891 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247893 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247896 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247900 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247903 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247906 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247909 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247912 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247914 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247917 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247920 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247923 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247926 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247929 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247931 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247940 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247943 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247945 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247948 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:40:21.894819 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:19.247950 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.247955 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.248108 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.250475 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.251899 2572 server.go:1019] "Starting client certificate rotation" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.251999 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.252684 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.254501 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.256064 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.266953 2572 log.go:25] "Validated CRI v1 runtime API" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.271962 2572 log.go:25] "Validated CRI v1 image API" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.273382 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 00:40:21.895516 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.275757 2572 fs.go:135] Filesystem UUIDs: map[6536a7a2-e96a-454d-a94b-a74c28b3583f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cdc7130e-889d-40ee-ae61-b4929b7112dd:/dev/nvme0n1p3] Jul 16 00:40:21.895905 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.275777 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.280719 2572 manager.go:216] Machine: {Timestamp:2026-07-16 00:40:19.279504591 +0000 UTC m=+0.332697941 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3127143 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec252c7dceababd721b7341ef29cd8c3 SystemUUID:ec252c7d-ceab-abd7-21b7-341ef29cd8c3 BootID:d350d14a-55e1-4c5f-8cc8-ef4677315650 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:f2:37:b6:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:f2:37:b6:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:7d:af:85:8c:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.280823 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.280934 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.282576 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.282601 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.283345 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.283357 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 00:40:21.896082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.283370 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.284661 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.286275 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.287084 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.290667 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.290782 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.290810 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.290818 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.290842 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.290851 2572 kubelet.go:398] "Adding apiserver pod source" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.290860 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.291194 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.291211 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.293226 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295397 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295426 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295591 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295603 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295608 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295614 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295623 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.295629 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.296126 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.296132 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.296140 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.296145 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.296192 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.296203 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.297541 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.297548 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.301861 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.302272 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.302272 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.303387 2572 server.go:1268] "Started kubelet" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.303448 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.303532 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.303602 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.305077 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.306381 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 16 00:40:21.896411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.309268 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-69zt7" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.309485 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.311249 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.311592 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.308768 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-73.ec2.internal.18c29e44782d9c1c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-73.ec2.internal,UID:ip-10-0-141-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-73.ec2.internal,},FirstTimestamp:2026-07-16 00:40:19.303357468 +0000 UTC m=+0.356550817,LastTimestamp:2026-07-16 00:40:19.303357468 +0000 UTC m=+0.356550817,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-73.ec2.internal,}" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.312345 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.312507 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.312581 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.312594 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.312700 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.312708 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.313354 2572 factory.go:55] Registering systemd factory Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.313369 2572 factory.go:223] Registration of the systemd container factory successfully Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.313680 2572 factory.go:153] Registering CRI-O factory Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.313698 2572 factory.go:223] Registration of the crio container factory successfully Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.313751 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.313784 2572 factory.go:103] Registering Raw factory Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.313799 2572 manager.go:1196] Started watching for new ooms in manager Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.313793 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.314413 2572 manager.go:349] Starting recovery of all containers Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.315782 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-69zt7" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.322483 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.329586 2572 manager.go:354] Recovery completed Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.333996 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.335846 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.335874 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.335885 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.336525 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.336537 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.336555 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.336553 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.337280 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:40:22.093556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.337304 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.337313 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.338664 2572 policy_none.go:49] "None policy: Start" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.338685 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.338695 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.340884 2572 policy_none.go:47] "Start" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.380554 2572 manager.go:337] "Starting Device Plugin manager" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.380740 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.380753 2572 server.go:87] "Starting device plugin registration server" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.380967 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.380977 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.381138 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.381238 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.381249 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.381843 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.381882 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.463355 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.464617 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.464650 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.464670 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.464719 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.467859 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.482338 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.483283 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.483311 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.483324 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.483352 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:19.494620 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.494640 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-73.ec2.internal\": node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:19.526561 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.696945 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal"] Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.697036 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.698662 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.698691 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.698701 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.701093 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.701238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.701271 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:40:22.095206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.702492 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.702520 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.702534 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.703776 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.703813 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.703828 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.706320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.706355 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.708780 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.708813 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.708829 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:21.736353 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-73.ec2.internal\" not found" node="ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:21.741914 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-73.ec2.internal\" not found" node="ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.745117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1842fdbbc2bf5aa003fd47600a0a8e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal\" (UID: \"a1842fdbbc2bf5aa003fd47600a0a8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.745143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1842fdbbc2bf5aa003fd47600a0a8e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal\" (UID: \"a1842fdbbc2bf5aa003fd47600a0a8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.745161 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b2e747f657eca90dcd990d916372685-config\") pod \"kube-apiserver-proxy-ip-10-0-141-73.ec2.internal\" (UID: \"5b2e747f657eca90dcd990d916372685\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:21.757785 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.846003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1842fdbbc2bf5aa003fd47600a0a8e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal\" (UID: \"a1842fdbbc2bf5aa003fd47600a0a8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.846038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b2e747f657eca90dcd990d916372685-config\") pod \"kube-apiserver-proxy-ip-10-0-141-73.ec2.internal\" (UID: \"5b2e747f657eca90dcd990d916372685\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.846057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1842fdbbc2bf5aa003fd47600a0a8e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal\" (UID: \"a1842fdbbc2bf5aa003fd47600a0a8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096239 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.846105 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1842fdbbc2bf5aa003fd47600a0a8e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal\" (UID: \"a1842fdbbc2bf5aa003fd47600a0a8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096822 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.846120 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1842fdbbc2bf5aa003fd47600a0a8e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal\" (UID: \"a1842fdbbc2bf5aa003fd47600a0a8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096822 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:21.846120 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b2e747f657eca90dcd990d916372685-config\") pod \"kube-apiserver-proxy-ip-10-0-141-73.ec2.internal\" (UID: \"5b2e747f657eca90dcd990d916372685\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096822 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:21.858788 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.096822 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:21.960449 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.096822 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.038700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096822 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.046826 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" Jul 16 00:40:22.096822 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.062315 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.196343 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.162921 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.295667 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.263461 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.499042 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.364024 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.499042 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.382193 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 00:40:22.499042 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.382365 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 00:40:22.499042 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.454459 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 00:35:21 +0000 UTC" deadline="2028-03-12 18:20:17.632517205 +0000 UTC" Jul 16 00:40:22.499042 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.454485 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14537h39m55.178035306s" Jul 16 00:40:22.499042 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.464288 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.631933 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.564973 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.631933 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.626514 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:40:22.837919 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.665795 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.837919 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:22.706821 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2e747f657eca90dcd990d916372685.slice/crio-400a2d320b76544e9a34fcfe796d4c4cc9cf11e240bd98fe038db5f86402d719 WatchSource:0}: Error finding container 400a2d320b76544e9a34fcfe796d4c4cc9cf11e240bd98fe038db5f86402d719: Status 404 returned error can't find the container with id 400a2d320b76544e9a34fcfe796d4c4cc9cf11e240bd98fe038db5f86402d719 Jul 16 00:40:22.837919 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:22.707384 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1842fdbbc2bf5aa003fd47600a0a8e1.slice/crio-b2702f113b166329e272a8f301ef4d13ce4469b911c3db36bf5ee5b0512722a1 WatchSource:0}: Error finding container b2702f113b166329e272a8f301ef4d13ce4469b911c3db36bf5ee5b0512722a1: Status 404 returned error can't find the container with id b2702f113b166329e272a8f301ef4d13ce4469b911c3db36bf5ee5b0512722a1 Jul 16 00:40:22.837919 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.713141 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:40:22.837919 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.766672 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:22.837919 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.808089 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:40:23.045094 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.867327 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:23.045094 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:22.968071 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-73.ec2.internal\" not found" Jul 16 00:40:23.045094 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:22.969337 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:40:23.045094 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.043153 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" Jul 16 00:40:23.188373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.054237 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:40:23.188373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.055199 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" Jul 16 00:40:23.188373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.064167 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:40:23.423048 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.422775 2572 apiserver.go:52] "Watching apiserver" Jul 16 00:40:23.428133 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.427944 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 00:40:23.428712 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.428333 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-crkgs","openshift-image-registry/node-ca-zvdbq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-kwsl2","openshift-multus/multus-wnxjq","openshift-multus/network-metrics-daemon-xs9zv","openshift-network-diagnostics/network-check-target-k8sjs","openshift-network-operator/iptables-alerter-vzx6r","openshift-ovn-kubernetes/ovnkube-node-ls4xs","kube-system/global-pull-secret-syncer-szcgm","kube-system/konnectivity-agent-xx95k","kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h","openshift-cluster-node-tuning-operator/tuned-fkm8t"] Jul 16 00:40:23.430997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.430977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:23.431107 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.431061 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:23.433244 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.433218 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.435442 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.435421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.437975 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.437673 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.439287 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.439226 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:40:23.439287 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.439250 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 00:40:23.439893 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.439874 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 00:40:23.440110 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.440090 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 00:40:23.440359 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.440340 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 00:40:23.445144 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.442974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.445144 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.444857 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xk8pw\"" Jul 16 00:40:23.445144 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.445113 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.445442 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.445742 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t4tft\"" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.446138 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6fk4l\"" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.446419 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.446739 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.446760 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.447028 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.447094 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:23.447943 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.447193 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:23.448439 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.448362 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.452106 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.452088 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.454293 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.454219 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.454944 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.454892 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 00:40:23.455060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-cnibin\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.455191 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-etc-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455191 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-run-ovn-kubernetes\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455191 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zggs9\" (UniqueName: \"kubernetes.io/projected/cb3e7e13-9f7c-440e-b506-2df6543ff81b-kube-api-access-zggs9\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455191 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysctl-d\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.455191 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a06b2fa5-1c25-4f50-a580-9eb0188a6145-tmp\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-os-release\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hg8l\" (UniqueName: \"kubernetes.io/projected/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-kube-api-access-6hg8l\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455327 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-cni-binary-copy\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-etc-kubernetes\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-run-netns\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-k8s-cni-cncf-io\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.455501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455493 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-system-cni-dir\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455522 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-system-cni-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455593 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-socket-dir-parent\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-systemd\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455671 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smd2h\"" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovn-node-metrics-cert\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-device-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7xq\" (UniqueName: \"kubernetes.io/projected/a06b2fa5-1c25-4f50-a580-9eb0188a6145-kube-api-access-gj7xq\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhnpz\" (UniqueName: \"kubernetes.io/projected/61f1d642-4155-4316-b07f-f3089a14e979-kube-api-access-rhnpz\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-log-socket\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455794 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-cni-bin\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.455922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455795 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455820 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovnkube-config\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbcl4\" (UniqueName: \"kubernetes.io/projected/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-kube-api-access-sbcl4\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-node-log\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysconfig\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.455959 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-kubernetes\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456010 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456047 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456052 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-sys\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456120 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5trw6\"" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-conf-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovnkube-script-lib\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-var-lib-kubelet\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfj97\" (UniqueName: \"kubernetes.io/projected/62b402c9-ccde-4693-a9d1-c76f6554e0a8-kube-api-access-xfj97\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456252 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-systemd\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.457350 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456254 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jdplp\"" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-netns\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-slash\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-ovn\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-socket-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-os-release\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456540 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-sys-fs\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysctl-conf\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.458067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-lib-modules\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-tuned\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456631 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-var-lib-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456697 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-run\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-host\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-cni-bin\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-kubelet\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-registration-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-kubelet\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-cni-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.456894 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457198 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7w298\"" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-hostroot\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-daemon-config\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.458684 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457474 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-multus-certs\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-cni-netd\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-modprobe-d\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457567 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457572 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-cni-multus\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457595 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-systemd-units\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457616 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-env-overrides\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.457635 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-cnibin\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.459356 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.457729 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 00:40:23.459739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.459638 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.462041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.462006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.463574 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.462848 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 00:40:23.464475 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.464451 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pvz4l\"" Jul 16 00:40:23.466633 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.466588 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:40:23.466942 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.466920 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-grtzs\"" Jul 16 00:40:23.467448 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.467431 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 00:40:23.467747 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.467727 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 00:40:23.470002 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.469985 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 00:40:23.470154 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.470019 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 00:40:23.470322 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.470070 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 00:40:23.479875 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.479849 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:40:23.521463 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.521440 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xzb2" Jul 16 00:40:23.541342 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.541294 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xzb2" Jul 16 00:40:23.545003 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.544982 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 00:40:23.558890 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.558855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.559041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.558900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysconfig\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.558931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-kubernetes\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.558956 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-sys\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.558981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-conf-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.559041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovnkube-script-lib\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.559041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559033 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49a38a03-2af4-4d71-9291-8940c87c16bc-konnectivity-ca\") pod \"konnectivity-agent-xx95k\" (UID: \"49a38a03-2af4-4d71-9291-8940c87c16bc\") " pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.559041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559035 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc7tm\" (UniqueName: \"kubernetes.io/projected/c43adfa7-c983-4f34-93f8-961393b3da49-kube-api-access-qc7tm\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-var-lib-kubelet\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfj97\" (UniqueName: \"kubernetes.io/projected/62b402c9-ccde-4693-a9d1-c76f6554e0a8-kube-api-access-xfj97\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559118 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysconfig\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-systemd\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559192 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-kubernetes\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-netns\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-slash\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559245 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-sys\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559293 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-conf-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.559420 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559374 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-var-lib-kubelet\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-ovn\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559425 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmk85\" (UniqueName: \"kubernetes.io/projected/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-kube-api-access-jmk85\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48358819-a2c3-4f11-a357-37146e084dc3-kubelet-config\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-socket-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-os-release\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-tmp-dir\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559607 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-sys-fs\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysctl-conf\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-lib-modules\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559677 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-tuned\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-var-lib-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.560098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559729 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-systemd\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559757 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49a38a03-2af4-4d71-9291-8940c87c16bc-agent-certs\") pod \"konnectivity-agent-xx95k\" (UID: \"49a38a03-2af4-4d71-9291-8940c87c16bc\") " pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-run\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-host\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-cni-bin\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-kubelet\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.559965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-registration-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-kubelet\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48358819-a2c3-4f11-a357-37146e084dc3-dbus\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560137 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b686682-de75-4b1e-ac38-ee27e835991d-iptables-alerter-script\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c43adfa7-c983-4f34-93f8-961393b3da49-serviceca\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-cni-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-hostroot\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-daemon-config\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.560748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560346 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-multus-certs\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-cni-netd\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-modprobe-d\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560441 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-netns\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560493 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-cni-multus\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560563 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-slash\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-cni-multus\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560852 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-systemd-units\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560879 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-env-overrides\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbg58\" (UniqueName: \"kubernetes.io/projected/5b686682-de75-4b1e-ac38-ee27e835991d-kube-api-access-cbg58\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560946 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43adfa7-c983-4f34-93f8-961393b3da49-host\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-cnibin\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-cnibin\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-etc-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-run-ovn-kubernetes\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.561494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zggs9\" (UniqueName: \"kubernetes.io/projected/cb3e7e13-9f7c-440e-b506-2df6543ff81b-kube-api-access-zggs9\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysctl-d\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561149 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a06b2fa5-1c25-4f50-a580-9eb0188a6145-tmp\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-os-release\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561121 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovnkube-script-lib\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561410 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hg8l\" (UniqueName: \"kubernetes.io/projected/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-kube-api-access-6hg8l\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b686682-de75-4b1e-ac38-ee27e835991d-host-slash\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561493 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-cni-binary-copy\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-etc-kubernetes\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-run-netns\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561627 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-k8s-cni-cncf-io\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-system-cni-dir\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561698 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.562159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561764 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-ovn\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-system-cni-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.561990 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-system-cni-dir\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-socket-dir-parent\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.562065 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-systemd\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovn-node-metrics-cert\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562134 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.562159 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs podName:4aaeb25d-8cf9-49b3-8214-d742dfe94a72 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:24.062108948 +0000 UTC m=+2.984157755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs") pod "network-metrics-daemon-xs9zv" (UID: "4aaeb25d-8cf9-49b3-8214-d742dfe94a72") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562244 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-cni-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-device-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7xq\" (UniqueName: \"kubernetes.io/projected/a06b2fa5-1c25-4f50-a580-9eb0188a6145-kube-api-access-gj7xq\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.562802 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562307 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-kubelet\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhnpz\" (UniqueName: \"kubernetes.io/projected/61f1d642-4155-4316-b07f-f3089a14e979-kube-api-access-rhnpz\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-log-socket\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562378 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-k8s-cni-cncf-io\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562397 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-var-lib-cni-bin\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562436 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-cni-bin\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562467 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-os-release\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562477 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-sys-fs\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-hostroot\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562511 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-registration-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562535 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-cni-bin\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562557 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovnkube-config\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-hosts-file\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.563484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562638 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-kubelet\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562657 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562683 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-run\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbcl4\" (UniqueName: \"kubernetes.io/projected/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-kube-api-access-sbcl4\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562720 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-node-log\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562729 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-etc-kubernetes\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562761 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-lib-modules\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562835 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-host\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562905 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562979 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-run-netns\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563027 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-etc-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563033 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-socket-dir-parent\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563074 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61f1d642-4155-4316-b07f-f3089a14e979-cnibin\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563126 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-systemd\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564164 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563145 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-cnibin\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563173 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-system-cni-dir\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.560391 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61f1d642-4155-4316-b07f-f3089a14e979-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563372 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-modprobe-d\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563447 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-log-socket\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563482 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-env-overrides\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562295 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-socket-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-run-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563546 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-systemd-units\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563633 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-host-run-multus-certs\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563668 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62b402c9-ccde-4693-a9d1-c76f6554e0a8-device-dir\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-var-lib-openvswitch\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.562613 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysctl-conf\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563732 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-run-ovn-kubernetes\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563755 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-os-release\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.564843 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.563839 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-sysctl-d\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.565533 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.564080 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-multus-daemon-config\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.565533 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.565515 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovnkube-config\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.565968 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.565941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-node-log\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.566061 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.566003 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb3e7e13-9f7c-440e-b506-2df6543ff81b-host-cni-netd\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.566993 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.566760 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb3e7e13-9f7c-440e-b506-2df6543ff81b-ovn-node-metrics-cert\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.566993 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.566970 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a06b2fa5-1c25-4f50-a580-9eb0188a6145-tmp\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.571786 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.571765 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a06b2fa5-1c25-4f50-a580-9eb0188a6145-etc-tuned\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.572449 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.572429 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:40:23.572545 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.572458 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:40:23.572545 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.572471 2572 projected.go:196] Error preparing data for projected volume kube-api-access-k5pcm for pod openshift-network-diagnostics/network-check-target-k8sjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:23.572545 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.572533 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm podName:4bbd5852-d56f-4291-9815-2f56829fb8a7 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:24.072515222 +0000 UTC m=+2.994564031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pcm" (UniqueName: "kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm") pod "network-check-target-k8sjs" (UID: "4bbd5852-d56f-4291-9815-2f56829fb8a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:23.575245 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.575158 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-cni-binary-copy\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.592367 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.592341 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhnpz\" (UniqueName: \"kubernetes.io/projected/61f1d642-4155-4316-b07f-f3089a14e979-kube-api-access-rhnpz\") pod \"multus-additional-cni-plugins-kwsl2\" (UID: \"61f1d642-4155-4316-b07f-f3089a14e979\") " pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.593741 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.593697 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbcl4\" (UniqueName: \"kubernetes.io/projected/303ef4f7-7c29-4bbc-b847-9fea16cac6d8-kube-api-access-sbcl4\") pod \"multus-wnxjq\" (UID: \"303ef4f7-7c29-4bbc-b847-9fea16cac6d8\") " pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.595133 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.595102 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hg8l\" (UniqueName: \"kubernetes.io/projected/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-kube-api-access-6hg8l\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:23.595505 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.595481 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zggs9\" (UniqueName: \"kubernetes.io/projected/cb3e7e13-9f7c-440e-b506-2df6543ff81b-kube-api-access-zggs9\") pod \"ovnkube-node-ls4xs\" (UID: \"cb3e7e13-9f7c-440e-b506-2df6543ff81b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.597904 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.597416 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7xq\" (UniqueName: \"kubernetes.io/projected/a06b2fa5-1c25-4f50-a580-9eb0188a6145-kube-api-access-gj7xq\") pod \"tuned-fkm8t\" (UID: \"a06b2fa5-1c25-4f50-a580-9eb0188a6145\") " pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.600416 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.600393 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfj97\" (UniqueName: \"kubernetes.io/projected/62b402c9-ccde-4693-a9d1-c76f6554e0a8-kube-api-access-xfj97\") pod \"aws-ebs-csi-driver-node-gtn5h\" (UID: \"62b402c9-ccde-4693-a9d1-c76f6554e0a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.601479 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.601429 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" event={"ID":"5b2e747f657eca90dcd990d916372685","Type":"ContainerStarted","Data":"400a2d320b76544e9a34fcfe796d4c4cc9cf11e240bd98fe038db5f86402d719"} Jul 16 00:40:23.602689 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.602663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" event={"ID":"a1842fdbbc2bf5aa003fd47600a0a8e1","Type":"ContainerStarted","Data":"b2702f113b166329e272a8f301ef4d13ce4469b911c3db36bf5ee5b0512722a1"} Jul 16 00:40:23.663936 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.663892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmk85\" (UniqueName: \"kubernetes.io/projected/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-kube-api-access-jmk85\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.663936 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.663936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48358819-a2c3-4f11-a357-37146e084dc3-kubelet-config\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.663963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-tmp-dir\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.663991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49a38a03-2af4-4d71-9291-8940c87c16bc-agent-certs\") pod \"konnectivity-agent-xx95k\" (UID: \"49a38a03-2af4-4d71-9291-8940c87c16bc\") " pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664018 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48358819-a2c3-4f11-a357-37146e084dc3-dbus\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b686682-de75-4b1e-ac38-ee27e835991d-iptables-alerter-script\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c43adfa7-c983-4f34-93f8-961393b3da49-serviceca\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbg58\" (UniqueName: \"kubernetes.io/projected/5b686682-de75-4b1e-ac38-ee27e835991d-kube-api-access-cbg58\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664117 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43adfa7-c983-4f34-93f8-961393b3da49-host\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.664214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b686682-de75-4b1e-ac38-ee27e835991d-host-slash\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664238 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b686682-de75-4b1e-ac38-ee27e835991d-host-slash\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48358819-a2c3-4f11-a357-37146e084dc3-kubelet-config\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664403 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43adfa7-c983-4f34-93f8-961393b3da49-host\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664484 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48358819-a2c3-4f11-a357-37146e084dc3-dbus\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-hosts-file\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664556 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-tmp-dir\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664586 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49a38a03-2af4-4d71-9291-8940c87c16bc-konnectivity-ca\") pod \"konnectivity-agent-xx95k\" (UID: \"49a38a03-2af4-4d71-9291-8940c87c16bc\") " pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc7tm\" (UniqueName: \"kubernetes.io/projected/c43adfa7-c983-4f34-93f8-961393b3da49-kube-api-access-qc7tm\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.664622 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664620 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-hosts-file\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.665099 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.664883 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:23.665099 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.664897 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c43adfa7-c983-4f34-93f8-961393b3da49-serviceca\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.665099 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:23.664965 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret podName:48358819-a2c3-4f11-a357-37146e084dc3 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:24.164946109 +0000 UTC m=+3.086994901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret") pod "global-pull-secret-syncer-szcgm" (UID: "48358819-a2c3-4f11-a357-37146e084dc3") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:23.665099 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.665021 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b686682-de75-4b1e-ac38-ee27e835991d-iptables-alerter-script\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.665323 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.665113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49a38a03-2af4-4d71-9291-8940c87c16bc-konnectivity-ca\") pod \"konnectivity-agent-xx95k\" (UID: \"49a38a03-2af4-4d71-9291-8940c87c16bc\") " pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.667281 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.667246 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49a38a03-2af4-4d71-9291-8940c87c16bc-agent-certs\") pod \"konnectivity-agent-xx95k\" (UID: \"49a38a03-2af4-4d71-9291-8940c87c16bc\") " pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.680508 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.680472 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc7tm\" (UniqueName: \"kubernetes.io/projected/c43adfa7-c983-4f34-93f8-961393b3da49-kube-api-access-qc7tm\") pod \"node-ca-zvdbq\" (UID: \"c43adfa7-c983-4f34-93f8-961393b3da49\") " pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.682025 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.681984 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbg58\" (UniqueName: \"kubernetes.io/projected/5b686682-de75-4b1e-ac38-ee27e835991d-kube-api-access-cbg58\") pod \"iptables-alerter-vzx6r\" (UID: \"5b686682-de75-4b1e-ac38-ee27e835991d\") " pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:23.687055 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.687035 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmk85\" (UniqueName: \"kubernetes.io/projected/7d2bf0b8-da9c-428f-8d34-7026168c5f5b-kube-api-access-jmk85\") pod \"node-resolver-crkgs\" (UID: \"7d2bf0b8-da9c-428f-8d34-7026168c5f5b\") " pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.748699 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.748607 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" Jul 16 00:40:23.758008 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.757984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" Jul 16 00:40:23.758999 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.758976 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:40:23.767805 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.767785 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" Jul 16 00:40:23.775564 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.775542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wnxjq" Jul 16 00:40:23.790996 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.790973 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:23.799813 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.799791 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-crkgs" Jul 16 00:40:23.807774 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.807751 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zvdbq" Jul 16 00:40:23.815543 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.815521 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:23.822194 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:23.822158 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzx6r" Jul 16 00:40:24.067769 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:24.067679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:24.067929 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.067799 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:24.067929 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.067861 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs podName:4aaeb25d-8cf9-49b3-8214-d742dfe94a72 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:25.067847152 +0000 UTC m=+3.989895945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs") pod "network-metrics-daemon-xs9zv" (UID: "4aaeb25d-8cf9-49b3-8214-d742dfe94a72") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:24.168667 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:24.168626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:24.168827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:24.168704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:24.168827 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.168814 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:24.168827 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.168819 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:40:24.168980 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.168845 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:40:24.168980 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.168858 2572 projected.go:196] Error preparing data for projected volume kube-api-access-k5pcm for pod openshift-network-diagnostics/network-check-target-k8sjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:24.168980 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.168877 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret podName:48358819-a2c3-4f11-a357-37146e084dc3 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:25.168860843 +0000 UTC m=+4.090909648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret") pod "global-pull-secret-syncer-szcgm" (UID: "48358819-a2c3-4f11-a357-37146e084dc3") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:24.168980 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:24.168911 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm podName:4bbd5852-d56f-4291-9815-2f56829fb8a7 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:25.16889373 +0000 UTC m=+4.090942539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pcm" (UniqueName: "kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm") pod "network-check-target-k8sjs" (UID: "4bbd5852-d56f-4291-9815-2f56829fb8a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:24.544970 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:24.544868 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:35:23 +0000 UTC" deadline="2028-01-29 02:34:04.814276872 +0000 UTC" Jul 16 00:40:24.544970 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:24.544913 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13489h53m40.269368101s" Jul 16 00:40:24.719311 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:24.719217 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b402c9_ccde_4693_a9d1_c76f6554e0a8.slice/crio-87f5e4cb8f677eafd7ed31bb1f602a1d76e80ee1410cc1d15034329d27ac0163 WatchSource:0}: Error finding container 87f5e4cb8f677eafd7ed31bb1f602a1d76e80ee1410cc1d15034329d27ac0163: Status 404 returned error can't find the container with id 87f5e4cb8f677eafd7ed31bb1f602a1d76e80ee1410cc1d15034329d27ac0163 Jul 16 00:40:24.728231 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:24.728199 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f1d642_4155_4316_b07f_f3089a14e979.slice/crio-e838b6559eb4ca8175ebe54c76b0a0c8620cacddc408fbf6528ef31e307b5c50 WatchSource:0}: Error finding container e838b6559eb4ca8175ebe54c76b0a0c8620cacddc408fbf6528ef31e307b5c50: Status 404 returned error can't find the container with id e838b6559eb4ca8175ebe54c76b0a0c8620cacddc408fbf6528ef31e307b5c50 Jul 16 00:40:24.729611 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:24.729520 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303ef4f7_7c29_4bbc_b847_9fea16cac6d8.slice/crio-7541d77aba61363b5a66c2e9d30e11720be2de3908bc94b938ba43d363abe39d WatchSource:0}: Error finding container 7541d77aba61363b5a66c2e9d30e11720be2de3908bc94b938ba43d363abe39d: Status 404 returned error can't find the container with id 7541d77aba61363b5a66c2e9d30e11720be2de3908bc94b938ba43d363abe39d Jul 16 00:40:24.730507 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:24.730470 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06b2fa5_1c25_4f50_a580_9eb0188a6145.slice/crio-af152bfdc3d613bdc50866692614a7ef71cd9e197691f54703dbcf2930bc60eb WatchSource:0}: Error finding container af152bfdc3d613bdc50866692614a7ef71cd9e197691f54703dbcf2930bc60eb: Status 404 returned error can't find the container with id af152bfdc3d613bdc50866692614a7ef71cd9e197691f54703dbcf2930bc60eb Jul 16 00:40:24.732100 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:24.732069 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43adfa7_c983_4f34_93f8_961393b3da49.slice/crio-240227b83e628d37fc7048fb4df00a37d02aff180612ff75feae09da9ad823aa WatchSource:0}: Error finding container 240227b83e628d37fc7048fb4df00a37d02aff180612ff75feae09da9ad823aa: Status 404 returned error can't find the container with id 240227b83e628d37fc7048fb4df00a37d02aff180612ff75feae09da9ad823aa Jul 16 00:40:24.732820 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:24.732797 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a38a03_2af4_4d71_9291_8940c87c16bc.slice/crio-b4f459b60aac8fe7c9317d021f79aef1d0125b746302778bdd70ccf206c3a72b WatchSource:0}: Error finding container b4f459b60aac8fe7c9317d021f79aef1d0125b746302778bdd70ccf206c3a72b: Status 404 returned error can't find the container with id b4f459b60aac8fe7c9317d021f79aef1d0125b746302778bdd70ccf206c3a72b Jul 16 00:40:24.736773 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:40:24.736481 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b686682_de75_4b1e_ac38_ee27e835991d.slice/crio-c712801b76babf4102b7137e473f3479a786fe1bf05a228272c50c186ba73f91 WatchSource:0}: Error finding container c712801b76babf4102b7137e473f3479a786fe1bf05a228272c50c186ba73f91: Status 404 returned error can't find the container with id c712801b76babf4102b7137e473f3479a786fe1bf05a228272c50c186ba73f91 Jul 16 00:40:25.076044 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.076016 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:25.086669 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.086642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:25.086828 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.086721 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs podName:4aaeb25d-8cf9-49b3-8214-d742dfe94a72 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:27.086702058 +0000 UTC m=+6.008750851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs") pod "network-metrics-daemon-xs9zv" (UID: "4aaeb25d-8cf9-49b3-8214-d742dfe94a72") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:25.187545 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.187495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:25.187706 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.187556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:25.187778 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.187703 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:40:25.187778 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.187725 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:40:25.187778 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.187738 2572 projected.go:196] Error preparing data for projected volume kube-api-access-k5pcm for pod openshift-network-diagnostics/network-check-target-k8sjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:25.187933 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.187801 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm podName:4bbd5852-d56f-4291-9815-2f56829fb8a7 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:27.187782068 +0000 UTC m=+6.109830881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pcm" (UniqueName: "kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm") pod "network-check-target-k8sjs" (UID: "4bbd5852-d56f-4291-9815-2f56829fb8a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:25.188323 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.188303 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:25.188409 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.188365 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret podName:48358819-a2c3-4f11-a357-37146e084dc3 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:27.188348375 +0000 UTC m=+6.110397182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret") pod "global-pull-secret-syncer-szcgm" (UID: "48358819-a2c3-4f11-a357-37146e084dc3") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:25.545312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.545194 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:35:23 +0000 UTC" deadline="2028-03-12 09:53:41.487955707 +0000 UTC" Jul 16 00:40:25.545312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.545263 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14529h13m15.942697371s" Jul 16 00:40:25.599997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.598743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:25.599997 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.598877 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:25.599997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.598957 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:25.599997 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.599032 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:25.599997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.599096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:25.599997 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:25.599168 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:25.612454 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.612361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzx6r" event={"ID":"5b686682-de75-4b1e-ac38-ee27e835991d","Type":"ContainerStarted","Data":"c712801b76babf4102b7137e473f3479a786fe1bf05a228272c50c186ba73f91"} Jul 16 00:40:25.624815 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.624698 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"ae4a5e63e900f80e4f43cc958322165e607756f339002781fb17506028b0fed4"} Jul 16 00:40:25.633741 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.633709 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wnxjq" event={"ID":"303ef4f7-7c29-4bbc-b847-9fea16cac6d8","Type":"ContainerStarted","Data":"7541d77aba61363b5a66c2e9d30e11720be2de3908bc94b938ba43d363abe39d"} Jul 16 00:40:25.640590 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.640550 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerStarted","Data":"e838b6559eb4ca8175ebe54c76b0a0c8620cacddc408fbf6528ef31e307b5c50"} Jul 16 00:40:25.647792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.647756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-crkgs" event={"ID":"7d2bf0b8-da9c-428f-8d34-7026168c5f5b","Type":"ContainerStarted","Data":"47941ec7d2e447827de4b67f3e73eda9d52e2a819eaf5c2b5131dcd6de1c83aa"} Jul 16 00:40:25.650571 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.650534 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" event={"ID":"62b402c9-ccde-4693-a9d1-c76f6554e0a8","Type":"ContainerStarted","Data":"87f5e4cb8f677eafd7ed31bb1f602a1d76e80ee1410cc1d15034329d27ac0163"} Jul 16 00:40:25.661194 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.661144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" event={"ID":"5b2e747f657eca90dcd990d916372685","Type":"ContainerStarted","Data":"678a5dca9c30074ef4e26b930dede45da5b84fa98061d4daddcc25922658de8c"} Jul 16 00:40:25.667562 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.667458 2572 generic.go:356] "Generic (PLEG): container finished" podID="a1842fdbbc2bf5aa003fd47600a0a8e1" containerID="8ccd50f58865c62a14d9e11e14fa72adc04ef17caef35ba34040f8a6b21c851a" exitCode=0 Jul 16 00:40:25.667703 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.667563 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" event={"ID":"a1842fdbbc2bf5aa003fd47600a0a8e1","Type":"ContainerDied","Data":"8ccd50f58865c62a14d9e11e14fa72adc04ef17caef35ba34040f8a6b21c851a"} Jul 16 00:40:25.674453 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.674423 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xx95k" event={"ID":"49a38a03-2af4-4d71-9291-8940c87c16bc","Type":"ContainerStarted","Data":"b4f459b60aac8fe7c9317d021f79aef1d0125b746302778bdd70ccf206c3a72b"} Jul 16 00:40:25.682868 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.682837 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zvdbq" event={"ID":"c43adfa7-c983-4f34-93f8-961393b3da49","Type":"ContainerStarted","Data":"240227b83e628d37fc7048fb4df00a37d02aff180612ff75feae09da9ad823aa"} Jul 16 00:40:25.696502 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.696263 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-73.ec2.internal" podStartSLOduration=2.696245055 podStartE2EDuration="2.696245055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:25.677386951 +0000 UTC m=+4.599435767" watchObservedRunningTime="2026-07-16 00:40:25.696245055 +0000 UTC m=+4.618293871" Jul 16 00:40:25.701072 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:25.701041 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" event={"ID":"a06b2fa5-1c25-4f50-a580-9eb0188a6145","Type":"ContainerStarted","Data":"af152bfdc3d613bdc50866692614a7ef71cd9e197691f54703dbcf2930bc60eb"} Jul 16 00:40:26.715555 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:26.715520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" event={"ID":"a1842fdbbc2bf5aa003fd47600a0a8e1","Type":"ContainerStarted","Data":"e435c40dca1696b3ec3b52e9e58f3039f10e32fcd1c810d1007831682ec3e511"} Jul 16 00:40:27.103897 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:27.103006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:27.103897 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.103231 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:27.103897 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.103296 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs podName:4aaeb25d-8cf9-49b3-8214-d742dfe94a72 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:31.103277133 +0000 UTC m=+10.025325938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs") pod "network-metrics-daemon-xs9zv" (UID: "4aaeb25d-8cf9-49b3-8214-d742dfe94a72") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:27.204117 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:27.204193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.204350 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.204368 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.204381 2572 projected.go:196] Error preparing data for projected volume kube-api-access-k5pcm for pod openshift-network-diagnostics/network-check-target-k8sjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.204426 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.204442 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm podName:4bbd5852-d56f-4291-9815-2f56829fb8a7 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:31.204422247 +0000 UTC m=+10.126471063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pcm" (UniqueName: "kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm") pod "network-check-target-k8sjs" (UID: "4bbd5852-d56f-4291-9815-2f56829fb8a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:27.204788 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.204553 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret podName:48358819-a2c3-4f11-a357-37146e084dc3 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:31.204535545 +0000 UTC m=+10.126584353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret") pod "global-pull-secret-syncer-szcgm" (UID: "48358819-a2c3-4f11-a357-37146e084dc3") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:27.597366 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:27.597288 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:27.597526 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:27.597288 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:27.597526 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.597436 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:27.597632 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.597547 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:27.597632 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:27.597604 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:27.597735 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:27.597667 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:29.597215 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:29.596974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:29.597215 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:29.596981 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:29.597712 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:29.597265 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:29.597712 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:29.597126 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:29.597712 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:29.597313 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:29.597712 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:29.597388 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:31.141476 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:31.141040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:31.141476 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.141248 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:31.141476 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.141316 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs podName:4aaeb25d-8cf9-49b3-8214-d742dfe94a72 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:39.141296284 +0000 UTC m=+18.063345102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs") pod "network-metrics-daemon-xs9zv" (UID: "4aaeb25d-8cf9-49b3-8214-d742dfe94a72") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:31.241642 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:31.241601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:31.241798 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:31.241700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:31.241798 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.241756 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:40:31.241798 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.241784 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:40:31.241798 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.241799 2572 projected.go:196] Error preparing data for projected volume kube-api-access-k5pcm for pod openshift-network-diagnostics/network-check-target-k8sjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:31.242015 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.241808 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:31.242015 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.241867 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm podName:4bbd5852-d56f-4291-9815-2f56829fb8a7 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:39.241851992 +0000 UTC m=+18.163900789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pcm" (UniqueName: "kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm") pod "network-check-target-k8sjs" (UID: "4bbd5852-d56f-4291-9815-2f56829fb8a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:31.242015 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.241889 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret podName:48358819-a2c3-4f11-a357-37146e084dc3 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:39.24187928 +0000 UTC m=+18.163928072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret") pod "global-pull-secret-syncer-szcgm" (UID: "48358819-a2c3-4f11-a357-37146e084dc3") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:31.601517 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:31.601441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:31.601705 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.601619 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:31.601917 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:31.601900 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:31.601997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:31.601900 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:31.602058 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.602006 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:31.602110 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:31.602067 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:33.599159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:33.596970 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:33.599159 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:33.597118 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:33.599159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:33.597508 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:33.599159 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:33.597605 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:33.599159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:33.597652 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:33.599159 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:33.597714 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:35.597057 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:35.597023 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:35.597517 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:35.597023 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:35.597517 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:35.597164 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:35.597517 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:35.597158 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:35.597517 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:35.597284 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:35.597517 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:35.597368 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:37.596222 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:37.596169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:37.596661 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:37.596339 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:37.596661 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:37.596605 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:37.596661 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:37.596631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:37.596806 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:37.596715 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:37.596806 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:37.596787 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:39.206612 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:39.204418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:39.206612 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.204559 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:39.206612 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.204645 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs podName:4aaeb25d-8cf9-49b3-8214-d742dfe94a72 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:55.204624151 +0000 UTC m=+34.126672960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs") pod "network-metrics-daemon-xs9zv" (UID: "4aaeb25d-8cf9-49b3-8214-d742dfe94a72") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:39.305153 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:39.305110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:39.305353 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:39.305193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:39.305353 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.305289 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:39.305353 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.305320 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:40:39.305353 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.305342 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:40:39.305353 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.305354 2572 projected.go:196] Error preparing data for projected volume kube-api-access-k5pcm for pod openshift-network-diagnostics/network-check-target-k8sjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:39.305528 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.305372 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret podName:48358819-a2c3-4f11-a357-37146e084dc3 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:55.305353017 +0000 UTC m=+34.227402013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret") pod "global-pull-secret-syncer-szcgm" (UID: "48358819-a2c3-4f11-a357-37146e084dc3") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:39.305528 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.305395 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm podName:4bbd5852-d56f-4291-9815-2f56829fb8a7 nodeName:}" failed. No retries permitted until 2026-07-16 00:40:55.305382524 +0000 UTC m=+34.227431336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pcm" (UniqueName: "kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm") pod "network-check-target-k8sjs" (UID: "4bbd5852-d56f-4291-9815-2f56829fb8a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:39.599896 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:39.599814 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:39.600060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:39.599925 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:39.600060 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.599939 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:39.600060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:39.599958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:39.600060 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.600052 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:39.600270 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:39.600120 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:41.598866 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:41.598836 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:41.599322 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:41.598944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:41.599322 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:41.598991 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:41.599322 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:41.599074 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:41.599322 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:41.599087 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:41.599322 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:41.599219 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:43.596296 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.596091 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:43.596296 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:43.596231 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:43.596708 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.596598 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:43.596708 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:43.596700 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:43.596806 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.596757 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:43.596901 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:43.596822 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:43.753354 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.753142 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerStarted","Data":"8d8dba40a94a3f3a48a2027444336986c895864cfea307d412d5b3c211caf99c"} Jul 16 00:40:43.755060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.755026 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-crkgs" event={"ID":"7d2bf0b8-da9c-428f-8d34-7026168c5f5b","Type":"ContainerStarted","Data":"c577fff51285bf70f2e4ac874e14b855443f7cb1d69e609989055ef6e50d539c"} Jul 16 00:40:43.756826 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.756797 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" event={"ID":"62b402c9-ccde-4693-a9d1-c76f6554e0a8","Type":"ContainerStarted","Data":"8654e9b8633b1c4da4d249d1e16e16d216a94b809b243b2f65e0d837a6664d0d"} Jul 16 00:40:43.759140 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.759112 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xx95k" event={"ID":"49a38a03-2af4-4d71-9291-8940c87c16bc","Type":"ContainerStarted","Data":"2d004f4c279f15c1532f411510f50e111b151f3865590abdc5c2eb11e98a9ba4"} Jul 16 00:40:43.761874 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.761814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zvdbq" event={"ID":"c43adfa7-c983-4f34-93f8-961393b3da49","Type":"ContainerStarted","Data":"5152b653ebdc882e5ee2f7d407de96a57bbb7830e82b1fc84c7e92ab3c3b7277"} Jul 16 00:40:43.763449 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.763413 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" event={"ID":"a06b2fa5-1c25-4f50-a580-9eb0188a6145","Type":"ContainerStarted","Data":"a3fc22615807e62faf1e3ff786d1438aa445dc15fcc51596d54f0d92a3873d29"} Jul 16 00:40:43.767703 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.767672 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"18eac1f9288caa1de87929a9c3a3b444dde7d42bb47c89dbe3210e2b08fe4bce"} Jul 16 00:40:43.771442 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.771416 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wnxjq" event={"ID":"303ef4f7-7c29-4bbc-b847-9fea16cac6d8","Type":"ContainerStarted","Data":"4beb058dfb722b9a86bdac209571fda3bab3af44408b6a7bd61c2515aa864f2a"} Jul 16 00:40:43.779567 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.776784 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-73.ec2.internal" podStartSLOduration=20.776770888 podStartE2EDuration="20.776770888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:26.7318144 +0000 UTC m=+5.653863216" watchObservedRunningTime="2026-07-16 00:40:43.776770888 +0000 UTC m=+22.698819703" Jul 16 00:40:43.793997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.793949 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fkm8t" podStartSLOduration=4.015786717 podStartE2EDuration="22.793935361s" totalImagesPullingTime="18.778148644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:43.793681409 +0000 UTC m=+22.715730224" watchObservedRunningTime="2026-07-16 00:40:43.793935361 +0000 UTC m=+22.715984175" Jul 16 00:40:43.815016 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.814967 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wnxjq" podStartSLOduration=3.992053872 podStartE2EDuration="22.814950081s" totalImagesPullingTime="18.822896209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:43.814838281 +0000 UTC m=+22.736887097" watchObservedRunningTime="2026-07-16 00:40:43.814950081 +0000 UTC m=+22.736998901" Jul 16 00:40:43.855273 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.855206 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-crkgs" podStartSLOduration=4.080731754 podStartE2EDuration="22.855162185s" totalImagesPullingTime="18.774430431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:43.830268192 +0000 UTC m=+22.752317016" watchObservedRunningTime="2026-07-16 00:40:43.855162185 +0000 UTC m=+22.777211002" Jul 16 00:40:43.856117 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.856073 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xx95k" podStartSLOduration=8.37247299 podStartE2EDuration="22.856057763s" totalImagesPullingTime="14.483584773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:43.854861938 +0000 UTC m=+22.776910753" watchObservedRunningTime="2026-07-16 00:40:43.856057763 +0000 UTC m=+22.778106591" Jul 16 00:40:43.869553 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:43.869512 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zvdbq" podStartSLOduration=4.106925243 podStartE2EDuration="22.869497955s" totalImagesPullingTime="18.762572712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:43.868921209 +0000 UTC m=+22.790970055" watchObservedRunningTime="2026-07-16 00:40:43.869497955 +0000 UTC m=+22.791546769" Jul 16 00:40:44.190064 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.189904 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zvdbq_c43adfa7-c983-4f34-93f8-961393b3da49/node-ca/0.log" Jul 16 00:40:44.231041 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.230938 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:44.231571 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.231552 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:44.777564 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.777545 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:40:44.778135 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.777846 2572 generic.go:356] "Generic (PLEG): container finished" podID="cb3e7e13-9f7c-440e-b506-2df6543ff81b" containerID="81cd34139c6da87780e6facaae51ffb411b60fc9e6ba7e2ede044a636cd9783d" exitCode=1 Jul 16 00:40:44.778135 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.777922 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"76a00599b1ff628d183c6bdb913b75ef1036995718a5639d4304a522e6959303"} Jul 16 00:40:44.778135 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.778015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"3a23672b9de4f0fc86c3a48d52e1f45fa24f3f1b66e9cad43aed8afaafabdcbf"} Jul 16 00:40:44.778135 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.778072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"5437d1acd022162db603949279e6c2d419be1d7381ad6f744eb124c855e70155"} Jul 16 00:40:44.778135 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.778114 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"0bcb34dafbb51e5c50ab9f358a03f58c9992bb6acda023137b9508f097b89351"} Jul 16 00:40:44.778372 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.778149 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerDied","Data":"81cd34139c6da87780e6facaae51ffb411b60fc9e6ba7e2ede044a636cd9783d"} Jul 16 00:40:44.779297 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.779275 2572 generic.go:356] "Generic (PLEG): container finished" podID="61f1d642-4155-4316-b07f-f3089a14e979" containerID="8d8dba40a94a3f3a48a2027444336986c895864cfea307d412d5b3c211caf99c" exitCode=0 Jul 16 00:40:44.779400 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.779379 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerDied","Data":"8d8dba40a94a3f3a48a2027444336986c895864cfea307d412d5b3c211caf99c"} Jul 16 00:40:44.780146 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.780126 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:44.780530 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.780517 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xx95k" Jul 16 00:40:44.995373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:44.995347 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 00:40:45.524161 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.524041 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T00:40:44.995367555Z","UUID":"32c2926f-6dfe-43a2-b901-7971292b98bc","Handler":null,"Name":"","Endpoint":""} Jul 16 00:40:45.527008 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.526976 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 00:40:45.527197 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.527030 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 00:40:45.600889 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.600860 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:45.601048 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:45.600986 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:45.601347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.601325 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:45.601434 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:45.601418 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:45.601500 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.601487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:45.601561 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:45.601544 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:45.783558 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.783473 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzx6r" event={"ID":"5b686682-de75-4b1e-ac38-ee27e835991d","Type":"ContainerStarted","Data":"83b479556b220d07c1df1b2fbc9cd889caa2763a74762beeee7cdea0a3c8b68f"} Jul 16 00:40:45.785890 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.785857 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" event={"ID":"62b402c9-ccde-4693-a9d1-c76f6554e0a8","Type":"ContainerStarted","Data":"7aff4a0118ce23115962abef3995ce1f96b24c3d381dcce0af056c97c7ba3ccf"} Jul 16 00:40:45.807427 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:45.807365 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vzx6r" podStartSLOduration=6.043757156 podStartE2EDuration="24.807344225s" totalImagesPullingTime="18.763587069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:45.806759106 +0000 UTC m=+24.728807926" watchObservedRunningTime="2026-07-16 00:40:45.807344225 +0000 UTC m=+24.729393042" Jul 16 00:40:46.791794 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:46.791563 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:40:46.792342 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:46.792266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"5c79f33cb9d5fea1a2e839d4e950c51ec12e3c9f851277a1444bd3abd65b0683"} Jul 16 00:40:46.794565 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:46.794536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" event={"ID":"62b402c9-ccde-4693-a9d1-c76f6554e0a8","Type":"ContainerStarted","Data":"71ca0a8b4a963a7a162fa0d93b638b45873d8c8c75676a813e992648c7094069"} Jul 16 00:40:46.811893 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:46.811856 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtn5h" podStartSLOduration=4.707148614 podStartE2EDuration="25.811842539s" totalImagesPullingTime="21.104693925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:46.811714482 +0000 UTC m=+25.733763300" watchObservedRunningTime="2026-07-16 00:40:46.811842539 +0000 UTC m=+25.733891401" Jul 16 00:40:47.596044 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:47.596012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:47.596295 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:47.596012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:47.596295 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:47.596141 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:47.596295 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:47.596012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:47.596295 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:47.596228 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:47.596295 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:47.596277 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:49.597129 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.596895 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:49.597884 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.596898 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:49.597884 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:49.597208 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:49.597884 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.596938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:49.597884 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:49.597284 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:49.597884 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:49.597320 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:49.804878 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.804847 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:40:49.805242 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.805208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"845780de6a99a9a04ee6e886e4838e92d333e9e53f649e4dab23e3ac8439d1ce"} Jul 16 00:40:49.805550 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.805528 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:49.805704 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.805686 2572 scope.go:117] "RemoveContainer" containerID="81cd34139c6da87780e6facaae51ffb411b60fc9e6ba7e2ede044a636cd9783d" Jul 16 00:40:49.807533 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.807164 2572 generic.go:356] "Generic (PLEG): container finished" podID="61f1d642-4155-4316-b07f-f3089a14e979" containerID="566551f89651610ce885fa1f5ea51bc84290f9788165e891aa1d9bc753f1d841" exitCode=0 Jul 16 00:40:49.807533 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.807214 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerDied","Data":"566551f89651610ce885fa1f5ea51bc84290f9788165e891aa1d9bc753f1d841"} Jul 16 00:40:49.821970 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:49.821947 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:50.812960 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:50.812936 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:40:50.813434 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:50.813280 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" event={"ID":"cb3e7e13-9f7c-440e-b506-2df6543ff81b","Type":"ContainerStarted","Data":"0db9b8f830cfd6ce092d0f390ca5727e66776f7ec0f4179b28e81e21eb119cf0"} Jul 16 00:40:50.813483 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:50.813458 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:50.813526 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:50.813521 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:50.828426 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:50.828398 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:40:50.841026 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:50.840981 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" podStartSLOduration=10.99126771 podStartE2EDuration="29.840967582s" totalImagesPullingTime="18.849699872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:40:50.839345045 +0000 UTC m=+29.761393878" watchObservedRunningTime="2026-07-16 00:40:50.840967582 +0000 UTC m=+29.763016396" Jul 16 00:40:51.597451 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:51.597415 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:51.597640 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:51.597515 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:51.597640 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:51.597535 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:51.597640 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:51.597605 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:51.597640 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:51.597621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:51.597769 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:51.597711 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:51.817887 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:51.817850 2572 generic.go:356] "Generic (PLEG): container finished" podID="61f1d642-4155-4316-b07f-f3089a14e979" containerID="2736378a4fcaf9211cb64e464808315887d56f38a15be7a9f863aadcc049def4" exitCode=0 Jul 16 00:40:51.818295 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:51.817917 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerDied","Data":"2736378a4fcaf9211cb64e464808315887d56f38a15be7a9f863aadcc049def4"} Jul 16 00:40:53.596090 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:53.596058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:53.596476 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:53.596058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:53.596476 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:53.596167 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:53.596476 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:53.596058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:53.596476 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:53.596252 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:53.596476 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:53.596352 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:53.824815 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:53.824780 2572 generic.go:356] "Generic (PLEG): container finished" podID="61f1d642-4155-4316-b07f-f3089a14e979" containerID="022f02501324d407a13cf843fc9296112cf64312a4be0ee8ccb6b0a84bb2bf12" exitCode=0 Jul 16 00:40:53.824978 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:53.824841 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerDied","Data":"022f02501324d407a13cf843fc9296112cf64312a4be0ee8ccb6b0a84bb2bf12"} Jul 16 00:40:55.223765 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:55.223731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:55.224215 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.223847 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:55.224215 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.223911 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs podName:4aaeb25d-8cf9-49b3-8214-d742dfe94a72 nodeName:}" failed. No retries permitted until 2026-07-16 00:41:27.223892465 +0000 UTC m=+66.145941277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs") pod "network-metrics-daemon-xs9zv" (UID: "4aaeb25d-8cf9-49b3-8214-d742dfe94a72") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:40:55.325014 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:55.324981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:55.325166 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:55.325026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:55.325166 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.325126 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:55.325269 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.325200 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret podName:48358819-a2c3-4f11-a357-37146e084dc3 nodeName:}" failed. No retries permitted until 2026-07-16 00:41:27.325171755 +0000 UTC m=+66.247220551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret") pod "global-pull-secret-syncer-szcgm" (UID: "48358819-a2c3-4f11-a357-37146e084dc3") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:40:55.325269 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.325133 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:40:55.325269 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.325234 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:40:55.325269 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.325243 2572 projected.go:196] Error preparing data for projected volume kube-api-access-k5pcm for pod openshift-network-diagnostics/network-check-target-k8sjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:55.325415 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.325289 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm podName:4bbd5852-d56f-4291-9815-2f56829fb8a7 nodeName:}" failed. No retries permitted until 2026-07-16 00:41:27.325278841 +0000 UTC m=+66.247327633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k5pcm" (UniqueName: "kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm") pod "network-check-target-k8sjs" (UID: "4bbd5852-d56f-4291-9815-2f56829fb8a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:40:55.596453 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:55.596373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:55.596615 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:55.596377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:55.596615 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.596514 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:55.596615 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:55.596377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:55.596615 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.596596 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:55.596835 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:55.596660 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:57.596592 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:57.596558 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:57.596592 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:57.596594 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:57.597103 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:57.596566 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:57.597103 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:57.596694 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:57.597103 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:57.596788 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:57.597103 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:57.596866 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:58.838810 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:58.838635 2572 generic.go:356] "Generic (PLEG): container finished" podID="61f1d642-4155-4316-b07f-f3089a14e979" containerID="0ad6c07888c7a38c09b4f124a80471ad7fc7dfcd8620ee685d43f2f6e61b3070" exitCode=0 Jul 16 00:40:58.838810 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:58.838698 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerDied","Data":"0ad6c07888c7a38c09b4f124a80471ad7fc7dfcd8620ee685d43f2f6e61b3070"} Jul 16 00:40:59.596357 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:59.596328 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:40:59.596539 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:59.596440 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:40:59.596539 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:59.596328 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:40:59.596628 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:59.596487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:40:59.596628 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:59.596592 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:40:59.596628 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:40:59.596611 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:40:59.844143 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:59.844109 2572 generic.go:356] "Generic (PLEG): container finished" podID="61f1d642-4155-4316-b07f-f3089a14e979" containerID="0cee7a481c4abd605feee487b24f929ef8b13f90e66d7c9850375f15fe8b31da" exitCode=0 Jul 16 00:40:59.844503 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:40:59.844160 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerDied","Data":"0cee7a481c4abd605feee487b24f929ef8b13f90e66d7c9850375f15fe8b31da"} Jul 16 00:41:00.849436 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:00.849403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" event={"ID":"61f1d642-4155-4316-b07f-f3089a14e979","Type":"ContainerStarted","Data":"602162cc5c739bfe04efa3e8166e28e50f24c1492cc16f9e0398900e31d9ff59"} Jul 16 00:41:00.872936 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:00.872886 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kwsl2" podStartSLOduration=10.685909145 podStartE2EDuration="39.872870614s" totalImagesPullingTime="29.186961469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:00.872834841 +0000 UTC m=+39.794883655" watchObservedRunningTime="2026-07-16 00:41:00.872870614 +0000 UTC m=+39.794919410" Jul 16 00:41:01.597479 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:01.597450 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:01.597651 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:01.597528 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:41:01.597651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:01.597630 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:01.597748 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:01.597729 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:41:01.597849 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:01.597831 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:01.597950 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:01.597929 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:41:03.596816 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:03.596778 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:03.596816 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:03.596807 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:03.597348 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:03.596793 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:03.597348 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:03.596889 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:41:03.597348 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:03.596988 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:41:03.597348 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:03.597094 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:41:05.596825 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:05.596789 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:05.597306 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:05.596897 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:41:05.597306 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:05.596789 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:05.597306 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:05.596931 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:05.597306 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:05.597043 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:41:05.597306 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:05.597100 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:41:06.572238 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:06.572207 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8sjs"] Jul 16 00:41:06.572410 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:06.572309 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:06.572477 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:06.572420 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:41:06.576608 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:06.576581 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-szcgm"] Jul 16 00:41:06.576745 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:06.576680 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:06.576812 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:06.576774 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:41:06.577374 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:06.577351 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xs9zv"] Jul 16 00:41:06.577492 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:06.577454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:06.577568 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:06.577547 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:41:07.596497 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:07.596467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:07.597207 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:07.596579 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:41:08.596903 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:08.596871 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:08.597364 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:08.596875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:08.597364 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:08.597026 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8sjs" podUID="4bbd5852-d56f-4291-9815-2f56829fb8a7" Jul 16 00:41:08.597364 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:08.597070 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szcgm" podUID="48358819-a2c3-4f11-a357-37146e084dc3" Jul 16 00:41:09.596894 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:09.596711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:09.597086 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:09.596999 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs9zv" podUID="4aaeb25d-8cf9-49b3-8214-d742dfe94a72" Jul 16 00:41:10.424680 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.424651 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-73.ec2.internal" event="NodeReady" Jul 16 00:41:10.424844 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.424795 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 00:41:10.546721 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.546680 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f5gkx"] Jul 16 00:41:10.567300 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.567273 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f5gkx"] Jul 16 00:41:10.567443 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.567364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.571739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.571549 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 00:41:10.571739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.571549 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 00:41:10.571966 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.571549 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tf6x9\"" Jul 16 00:41:10.571966 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.571549 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 00:41:10.582775 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.582753 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qf9rc"] Jul 16 00:41:10.605929 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.605902 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qf9rc"] Jul 16 00:41:10.606378 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.606013 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.606378 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.606056 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:10.606378 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.606217 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:10.610966 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.610948 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:41:10.611084 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.611032 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 00:41:10.611263 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.611248 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:41:10.613225 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.613158 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:41:10.613727 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.613707 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 00:41:10.613838 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.613777 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hn9ps\"" Jul 16 00:41:10.615704 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.615689 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ll89j\"" Jul 16 00:41:10.623862 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.623823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2tmj\" (UniqueName: \"kubernetes.io/projected/b680c65d-387e-4f06-b54d-72210ab9c223-kube-api-access-n2tmj\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.623967 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.623864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b680c65d-387e-4f06-b54d-72210ab9c223-metrics-tls\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.623967 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.623931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skgp\" (UniqueName: \"kubernetes.io/projected/37c10581-0b88-4d20-b08b-0fbcd098d04f-kube-api-access-9skgp\") pod \"ingress-canary-f5gkx\" (UID: \"37c10581-0b88-4d20-b08b-0fbcd098d04f\") " pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.623967 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.623951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b680c65d-387e-4f06-b54d-72210ab9c223-tmp-dir\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.624199 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.623986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b680c65d-387e-4f06-b54d-72210ab9c223-config-volume\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.624199 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.624035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c10581-0b88-4d20-b08b-0fbcd098d04f-cert\") pod \"ingress-canary-f5gkx\" (UID: \"37c10581-0b88-4d20-b08b-0fbcd098d04f\") " pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.626341 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.626321 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p76g8"] Jul 16 00:41:10.652219 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.652167 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.653715 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.653645 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p76g8"] Jul 16 00:41:10.658626 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.658600 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 00:41:10.658824 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.658703 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 00:41:10.658824 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.658719 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 00:41:10.659031 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.659000 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6hgb5\"" Jul 16 00:41:10.659680 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.659658 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 00:41:10.724847 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.724763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b680c65d-387e-4f06-b54d-72210ab9c223-config-volume\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.724847 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.724800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c10581-0b88-4d20-b08b-0fbcd098d04f-cert\") pod \"ingress-canary-f5gkx\" (UID: \"37c10581-0b88-4d20-b08b-0fbcd098d04f\") " pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.724847 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.724833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef9f9684-04b8-4c31-84f8-bf0a95746094-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.725121 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.724861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef9f9684-04b8-4c31-84f8-bf0a95746094-crio-socket\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.725121 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.724927 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcszf\" (UniqueName: \"kubernetes.io/projected/ef9f9684-04b8-4c31-84f8-bf0a95746094-kube-api-access-xcszf\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.725121 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2tmj\" (UniqueName: \"kubernetes.io/projected/b680c65d-387e-4f06-b54d-72210ab9c223-kube-api-access-n2tmj\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.725121 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef9f9684-04b8-4c31-84f8-bf0a95746094-data-volume\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.725121 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b680c65d-387e-4f06-b54d-72210ab9c223-metrics-tls\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.725391 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725125 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9skgp\" (UniqueName: \"kubernetes.io/projected/37c10581-0b88-4d20-b08b-0fbcd098d04f-kube-api-access-9skgp\") pod \"ingress-canary-f5gkx\" (UID: \"37c10581-0b88-4d20-b08b-0fbcd098d04f\") " pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.725391 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b680c65d-387e-4f06-b54d-72210ab9c223-tmp-dir\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.725391 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef9f9684-04b8-4c31-84f8-bf0a95746094-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.725653 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725509 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b680c65d-387e-4f06-b54d-72210ab9c223-tmp-dir\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.725653 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.725521 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b680c65d-387e-4f06-b54d-72210ab9c223-config-volume\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.729057 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.729032 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b680c65d-387e-4f06-b54d-72210ab9c223-metrics-tls\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.729150 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.729072 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c10581-0b88-4d20-b08b-0fbcd098d04f-cert\") pod \"ingress-canary-f5gkx\" (UID: \"37c10581-0b88-4d20-b08b-0fbcd098d04f\") " pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.738912 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.738888 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2tmj\" (UniqueName: \"kubernetes.io/projected/b680c65d-387e-4f06-b54d-72210ab9c223-kube-api-access-n2tmj\") pod \"dns-default-qf9rc\" (UID: \"b680c65d-387e-4f06-b54d-72210ab9c223\") " pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.739003 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.738925 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skgp\" (UniqueName: \"kubernetes.io/projected/37c10581-0b88-4d20-b08b-0fbcd098d04f-kube-api-access-9skgp\") pod \"ingress-canary-f5gkx\" (UID: \"37c10581-0b88-4d20-b08b-0fbcd098d04f\") " pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.825667 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.825620 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef9f9684-04b8-4c31-84f8-bf0a95746094-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.825667 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.825663 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef9f9684-04b8-4c31-84f8-bf0a95746094-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.825929 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.825686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef9f9684-04b8-4c31-84f8-bf0a95746094-crio-socket\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.825929 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.825708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcszf\" (UniqueName: \"kubernetes.io/projected/ef9f9684-04b8-4c31-84f8-bf0a95746094-kube-api-access-xcszf\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.825929 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.825749 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef9f9684-04b8-4c31-84f8-bf0a95746094-data-volume\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.825929 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.825884 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef9f9684-04b8-4c31-84f8-bf0a95746094-crio-socket\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.826119 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.826096 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef9f9684-04b8-4c31-84f8-bf0a95746094-data-volume\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.826358 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.826338 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef9f9684-04b8-4c31-84f8-bf0a95746094-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.827917 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.827895 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef9f9684-04b8-4c31-84f8-bf0a95746094-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.845377 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.845351 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcszf\" (UniqueName: \"kubernetes.io/projected/ef9f9684-04b8-4c31-84f8-bf0a95746094-kube-api-access-xcszf\") pod \"insights-runtime-extractor-p76g8\" (UID: \"ef9f9684-04b8-4c31-84f8-bf0a95746094\") " pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:10.876914 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.876888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f5gkx" Jul 16 00:41:10.922766 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.922745 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:10.962307 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:10.962276 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p76g8" Jul 16 00:41:11.100488 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.099708 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f5gkx"] Jul 16 00:41:11.104854 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.104824 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qf9rc"] Jul 16 00:41:11.110582 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:11.110554 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb680c65d_387e_4f06_b54d_72210ab9c223.slice/crio-563c5b585530ac53990f610efefbef64a9cbcd8644fc46e0c547ebeb32fe045a WatchSource:0}: Error finding container 563c5b585530ac53990f610efefbef64a9cbcd8644fc46e0c547ebeb32fe045a: Status 404 returned error can't find the container with id 563c5b585530ac53990f610efefbef64a9cbcd8644fc46e0c547ebeb32fe045a Jul 16 00:41:11.110809 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:11.110790 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c10581_0b88_4d20_b08b_0fbcd098d04f.slice/crio-8b908ab84d77546572abe929aa4c53b33c3f4e090e53697f5657909cfe1b7506 WatchSource:0}: Error finding container 8b908ab84d77546572abe929aa4c53b33c3f4e090e53697f5657909cfe1b7506: Status 404 returned error can't find the container with id 8b908ab84d77546572abe929aa4c53b33c3f4e090e53697f5657909cfe1b7506 Jul 16 00:41:11.128069 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.128021 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p76g8"] Jul 16 00:41:11.132344 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:11.132320 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9f9684_04b8_4c31_84f8_bf0a95746094.slice/crio-07d9406fcb0d958cfd4e8efc6d24d0fb57108abb71902080ea715d126630f85c WatchSource:0}: Error finding container 07d9406fcb0d958cfd4e8efc6d24d0fb57108abb71902080ea715d126630f85c: Status 404 returned error can't find the container with id 07d9406fcb0d958cfd4e8efc6d24d0fb57108abb71902080ea715d126630f85c Jul 16 00:41:11.601135 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.601105 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:11.603654 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.603631 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vmvq6\"" Jul 16 00:41:11.604408 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.604378 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:41:11.614973 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.614948 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75"] Jul 16 00:41:11.622016 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.621994 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:11.625687 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.625637 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-47pq6\"" Jul 16 00:41:11.626102 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.626072 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 00:41:11.630224 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.629140 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75"] Jul 16 00:41:11.733797 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.733758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d02d143d-1a95-4623-8b65-6e7e5d2830a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fpq75\" (UID: \"d02d143d-1a95-4623-8b65-6e7e5d2830a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:11.834570 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.834530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d02d143d-1a95-4623-8b65-6e7e5d2830a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fpq75\" (UID: \"d02d143d-1a95-4623-8b65-6e7e5d2830a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:11.834756 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:11.834740 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 16 00:41:11.834826 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:11.834808 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d02d143d-1a95-4623-8b65-6e7e5d2830a8-tls-certificates podName:d02d143d-1a95-4623-8b65-6e7e5d2830a8 nodeName:}" failed. No retries permitted until 2026-07-16 00:41:12.334789003 +0000 UTC m=+51.256837804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d02d143d-1a95-4623-8b65-6e7e5d2830a8-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-fpq75" (UID: "d02d143d-1a95-4623-8b65-6e7e5d2830a8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 16 00:41:11.875388 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.875242 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qf9rc" event={"ID":"b680c65d-387e-4f06-b54d-72210ab9c223","Type":"ContainerStarted","Data":"563c5b585530ac53990f610efefbef64a9cbcd8644fc46e0c547ebeb32fe045a"} Jul 16 00:41:11.878769 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.878674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p76g8" event={"ID":"ef9f9684-04b8-4c31-84f8-bf0a95746094","Type":"ContainerStarted","Data":"07d9406fcb0d958cfd4e8efc6d24d0fb57108abb71902080ea715d126630f85c"} Jul 16 00:41:11.880209 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:11.880141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f5gkx" event={"ID":"37c10581-0b88-4d20-b08b-0fbcd098d04f","Type":"ContainerStarted","Data":"8b908ab84d77546572abe929aa4c53b33c3f4e090e53697f5657909cfe1b7506"} Jul 16 00:41:12.340109 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:12.339959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d02d143d-1a95-4623-8b65-6e7e5d2830a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fpq75\" (UID: \"d02d143d-1a95-4623-8b65-6e7e5d2830a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:12.345271 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:12.345019 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d02d143d-1a95-4623-8b65-6e7e5d2830a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fpq75\" (UID: \"d02d143d-1a95-4623-8b65-6e7e5d2830a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:12.534325 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:12.534009 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:12.735748 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:12.735709 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75"] Jul 16 00:41:12.740067 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:12.740032 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02d143d_1a95_4623_8b65_6e7e5d2830a8.slice/crio-64d82f1fa7595575afb2a44bbf462e0ae7446f8447544fe4d966d77791ff56a2 WatchSource:0}: Error finding container 64d82f1fa7595575afb2a44bbf462e0ae7446f8447544fe4d966d77791ff56a2: Status 404 returned error can't find the container with id 64d82f1fa7595575afb2a44bbf462e0ae7446f8447544fe4d966d77791ff56a2 Jul 16 00:41:12.885114 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:12.884994 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" event={"ID":"d02d143d-1a95-4623-8b65-6e7e5d2830a8","Type":"ContainerStarted","Data":"64d82f1fa7595575afb2a44bbf462e0ae7446f8447544fe4d966d77791ff56a2"} Jul 16 00:41:18.906440 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.905954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f5gkx" event={"ID":"37c10581-0b88-4d20-b08b-0fbcd098d04f","Type":"ContainerStarted","Data":"21f52dfc65e1a0fb5992f78aba6809b6293351e9f287e762cc1b23cda619ffd5"} Jul 16 00:41:18.908503 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.908471 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" event={"ID":"d02d143d-1a95-4623-8b65-6e7e5d2830a8","Type":"ContainerStarted","Data":"5754a03fff1087629ae7b75e348ea2edac7328fa9529da90f1e98e4680592454"} Jul 16 00:41:18.908731 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.908712 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:18.911307 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.911277 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qf9rc" event={"ID":"b680c65d-387e-4f06-b54d-72210ab9c223","Type":"ContainerStarted","Data":"723d4a5c2b6ec016375a1bde036124c2b9e42aff5d7eac5197ed57a19b96539e"} Jul 16 00:41:18.911474 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.911326 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qf9rc" event={"ID":"b680c65d-387e-4f06-b54d-72210ab9c223","Type":"ContainerStarted","Data":"bc1973968b88aef86bbe8032198f8c9c5c2b4239a2b06eb5700ee15559cd4e02"} Jul 16 00:41:18.913547 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.913520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p76g8" event={"ID":"ef9f9684-04b8-4c31-84f8-bf0a95746094","Type":"ContainerStarted","Data":"16611419ffbed66800c98d2b65cc86edd555a625ef1dc1f5027f1f9f9c75fb2d"} Jul 16 00:41:18.915043 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.915023 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" Jul 16 00:41:18.925310 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.925223 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f5gkx" podStartSLOduration=2.003925644 podStartE2EDuration="8.925206671s" totalImagesPullingTime="6.921281027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:18.925040346 +0000 UTC m=+57.847089162" watchObservedRunningTime="2026-07-16 00:41:18.925206671 +0000 UTC m=+57.847255488" Jul 16 00:41:18.942378 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.942113 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qf9rc" podStartSLOduration=2.063987509 podStartE2EDuration="8.942091876s" totalImagesPullingTime="6.878104367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:18.941632896 +0000 UTC m=+57.863681711" watchObservedRunningTime="2026-07-16 00:41:18.942091876 +0000 UTC m=+57.864140692" Jul 16 00:41:18.959627 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:18.959546 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fpq75" podStartSLOduration=2.662935392 podStartE2EDuration="7.95952466s" totalImagesPullingTime="5.296589268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:18.958958015 +0000 UTC m=+57.881006858" watchObservedRunningTime="2026-07-16 00:41:18.95952466 +0000 UTC m=+57.881573475" Jul 16 00:41:19.690285 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.690246 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x6k9w"] Jul 16 00:41:19.696491 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.696468 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.700849 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.700822 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 00:41:19.701789 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.701764 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 00:41:19.701902 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.701793 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 00:41:19.701902 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.701884 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 00:41:19.701902 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.701891 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7gg5d\"" Jul 16 00:41:19.702083 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.702039 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 00:41:19.709277 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.709258 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x6k9w"] Jul 16 00:41:19.800386 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.800341 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.800559 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.800396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf8rk\" (UniqueName: \"kubernetes.io/projected/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-kube-api-access-sf8rk\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.800559 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.800446 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.800559 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.800490 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.901891 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.901852 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.902078 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.901914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.902078 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.902003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.902078 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:19.902013 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 16 00:41:19.902078 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.902030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf8rk\" (UniqueName: \"kubernetes.io/projected/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-kube-api-access-sf8rk\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.902383 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:19.902091 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-tls podName:345bf62b-9d90-48a2-bbc6-2ed6fc40ba22 nodeName:}" failed. No retries permitted until 2026-07-16 00:41:20.402069111 +0000 UTC m=+59.324117928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-tls") pod "prometheus-operator-64785b6675-x6k9w" (UID: "345bf62b-9d90-48a2-bbc6-2ed6fc40ba22") : secret "prometheus-operator-tls" not found Jul 16 00:41:19.902642 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.902619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.905158 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.905133 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.913742 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.913716 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf8rk\" (UniqueName: \"kubernetes.io/projected/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-kube-api-access-sf8rk\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:19.917551 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:19.917434 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:20.407023 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:20.406987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:20.409533 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:20.409502 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/345bf62b-9d90-48a2-bbc6-2ed6fc40ba22-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x6k9w\" (UID: \"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:20.606646 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:20.606610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" Jul 16 00:41:21.582523 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:21.582500 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x6k9w"] Jul 16 00:41:21.584591 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:21.584564 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345bf62b_9d90_48a2_bbc6_2ed6fc40ba22.slice/crio-e80f666f88733a4ec6f2d624ea5d716652ca4630a067f6562477e0c06f1b9252 WatchSource:0}: Error finding container e80f666f88733a4ec6f2d624ea5d716652ca4630a067f6562477e0c06f1b9252: Status 404 returned error can't find the container with id e80f666f88733a4ec6f2d624ea5d716652ca4630a067f6562477e0c06f1b9252 Jul 16 00:41:21.926222 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:21.926158 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p76g8" event={"ID":"ef9f9684-04b8-4c31-84f8-bf0a95746094","Type":"ContainerStarted","Data":"6b96c0ab16d11e632da679a607ef6aedb70e3213f53168978d94d421acfd7307"} Jul 16 00:41:21.927371 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:21.927340 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" event={"ID":"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22","Type":"ContainerStarted","Data":"e80f666f88733a4ec6f2d624ea5d716652ca4630a067f6562477e0c06f1b9252"} Jul 16 00:41:22.839758 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:22.839720 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ls4xs" Jul 16 00:41:23.936677 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:23.936643 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" event={"ID":"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22","Type":"ContainerStarted","Data":"cb5d53e2b87d19fe93e26faba48f5363c53ffb637a0a5cd32344d5c6f1468e29"} Jul 16 00:41:23.937107 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:23.936707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" event={"ID":"345bf62b-9d90-48a2-bbc6-2ed6fc40ba22","Type":"ContainerStarted","Data":"1acdee1a35dc567170db287b4afbc6aa5797ea11086e63d76f65709efa599e90"} Jul 16 00:41:23.959523 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:23.959477 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-x6k9w" podStartSLOduration=3.470431478 podStartE2EDuration="4.959462966s" totalImagesPullingTime="1.489031488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:23.958767706 +0000 UTC m=+62.880816547" watchObservedRunningTime="2026-07-16 00:41:23.959462966 +0000 UTC m=+62.881511781" Jul 16 00:41:25.945043 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:25.945007 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p76g8" event={"ID":"ef9f9684-04b8-4c31-84f8-bf0a95746094","Type":"ContainerStarted","Data":"bf8f93404ff1f52a808ca897941125e449869818adda0d6687837eb831d23c10"} Jul 16 00:41:25.969584 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:25.969532 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p76g8" podStartSLOduration=1.822438645 podStartE2EDuration="15.96951749s" totalImagesPullingTime="14.147078845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:41:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:25.969202709 +0000 UTC m=+64.891251520" watchObservedRunningTime="2026-07-16 00:41:25.96951749 +0000 UTC m=+64.891566305" Jul 16 00:41:26.043401 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.043369 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4pdcb"] Jul 16 00:41:26.046534 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.046516 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.048718 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.048692 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 00:41:26.048865 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.048720 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 00:41:26.048994 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.048980 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 00:41:26.049102 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.049084 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7s2vh\"" Jul 16 00:41:26.058606 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.058583 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-j8k46"] Jul 16 00:41:26.061655 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.061638 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.063639 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.063622 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 00:41:26.063639 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.063633 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 00:41:26.064022 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.064005 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t77b2\"" Jul 16 00:41:26.064211 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.064192 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 00:41:26.075562 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.075540 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-j8k46"] Jul 16 00:41:26.156795 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.156984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-wtmp\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.156984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-sys\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.156984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.156984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-tls\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.156984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9psw7\" (UniqueName: \"kubernetes.io/projected/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-api-access-9psw7\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.156984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156960 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-root\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.156984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.156981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-textfile\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.157351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.157008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41776ba-49e2-43eb-9493-ee5a1558ed34-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.157351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.157034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.157351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.157073 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.157351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.157116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js9sd\" (UniqueName: \"kubernetes.io/projected/9ecba924-650d-46f5-a5fd-a3903bd37214-kube-api-access-js9sd\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.157351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.157156 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e41776ba-49e2-43eb-9493-ee5a1558ed34-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.157351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.157225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ecba924-650d-46f5-a5fd-a3903bd37214-metrics-client-ca\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.157351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.157273 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-accelerators-collector-config\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258496 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.258496 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-wtmp\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258496 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-sys\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258496 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-tls\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9psw7\" (UniqueName: \"kubernetes.io/projected/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-api-access-9psw7\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-root\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-textfile\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41776ba-49e2-43eb-9493-ee5a1558ed34-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258607 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-wtmp\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258648 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-root\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:26.258666 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258615 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ecba924-650d-46f5-a5fd-a3903bd37214-sys\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js9sd\" (UniqueName: \"kubernetes.io/projected/9ecba924-650d-46f5-a5fd-a3903bd37214-kube-api-access-js9sd\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:26.258715 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 16 00:41:26.258827 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:26.258734 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-tls podName:9ecba924-650d-46f5-a5fd-a3903bd37214 nodeName:}" failed. No retries permitted until 2026-07-16 00:41:26.758714149 +0000 UTC m=+65.680762971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-tls") pod "node-exporter-4pdcb" (UID: "9ecba924-650d-46f5-a5fd-a3903bd37214") : secret "node-exporter-tls" not found Jul 16 00:41:26.259449 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:41:26.258757 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-tls podName:e41776ba-49e2-43eb-9493-ee5a1558ed34 nodeName:}" failed. No retries permitted until 2026-07-16 00:41:26.758746648 +0000 UTC m=+65.680795456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-j8k46" (UID: "e41776ba-49e2-43eb-9493-ee5a1558ed34") : secret "kube-state-metrics-tls" not found Jul 16 00:41:26.259449 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e41776ba-49e2-43eb-9493-ee5a1558ed34-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.259449 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ecba924-650d-46f5-a5fd-a3903bd37214-metrics-client-ca\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.259449 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-accelerators-collector-config\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.259449 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.258996 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-textfile\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.259449 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.259214 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e41776ba-49e2-43eb-9493-ee5a1558ed34-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.259449 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.259417 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41776ba-49e2-43eb-9493-ee5a1558ed34-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.259797 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.259582 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-accelerators-collector-config\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.259797 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.259591 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ecba924-650d-46f5-a5fd-a3903bd37214-metrics-client-ca\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.259797 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.259779 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.261432 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.261405 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.261528 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.261490 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.270981 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.270954 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js9sd\" (UniqueName: \"kubernetes.io/projected/9ecba924-650d-46f5-a5fd-a3903bd37214-kube-api-access-js9sd\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.271230 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.271208 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9psw7\" (UniqueName: \"kubernetes.io/projected/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-api-access-9psw7\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.712015 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.711980 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-629wb"] Jul 16 00:41:26.716333 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.716315 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-629wb" Jul 16 00:41:26.719165 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.719147 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 00:41:26.719273 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.719246 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 00:41:26.719328 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.719289 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v8smb\"" Jul 16 00:41:26.728112 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.728090 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-629wb"] Jul 16 00:41:26.761859 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.761826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.762043 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.761929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-tls\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.764231 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.764208 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ecba924-650d-46f5-a5fd-a3903bd37214-node-exporter-tls\") pod \"node-exporter-4pdcb\" (UID: \"9ecba924-650d-46f5-a5fd-a3903bd37214\") " pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.764367 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.764349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e41776ba-49e2-43eb-9493-ee5a1558ed34-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-j8k46\" (UID: \"e41776ba-49e2-43eb-9493-ee5a1558ed34\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.862792 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.862750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84dqf\" (UniqueName: \"kubernetes.io/projected/09337c65-25e6-4f53-bced-c71b3b268363-kube-api-access-84dqf\") pod \"downloads-68c9cbb497-629wb\" (UID: \"09337c65-25e6-4f53-bced-c71b3b268363\") " pod="openshift-console/downloads-68c9cbb497-629wb" Jul 16 00:41:26.955244 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.955210 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4pdcb" Jul 16 00:41:26.963283 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.963252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84dqf\" (UniqueName: \"kubernetes.io/projected/09337c65-25e6-4f53-bced-c71b3b268363-kube-api-access-84dqf\") pod \"downloads-68c9cbb497-629wb\" (UID: \"09337c65-25e6-4f53-bced-c71b3b268363\") " pod="openshift-console/downloads-68c9cbb497-629wb" Jul 16 00:41:26.965104 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:26.965080 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ecba924_650d_46f5_a5fd_a3903bd37214.slice/crio-7d72805ec086a08287f80468621118581bd31adc0546a14a6cb3ee0ce7ce5aac WatchSource:0}: Error finding container 7d72805ec086a08287f80468621118581bd31adc0546a14a6cb3ee0ce7ce5aac: Status 404 returned error can't find the container with id 7d72805ec086a08287f80468621118581bd31adc0546a14a6cb3ee0ce7ce5aac Jul 16 00:41:26.969739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.969713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" Jul 16 00:41:26.972011 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:26.971990 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84dqf\" (UniqueName: \"kubernetes.io/projected/09337c65-25e6-4f53-bced-c71b3b268363-kube-api-access-84dqf\") pod \"downloads-68c9cbb497-629wb\" (UID: \"09337c65-25e6-4f53-bced-c71b3b268363\") " pod="openshift-console/downloads-68c9cbb497-629wb" Jul 16 00:41:27.025689 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.025601 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-629wb" Jul 16 00:41:27.120741 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.120691 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-j8k46"] Jul 16 00:41:27.125201 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:27.125145 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41776ba_49e2_43eb_9493_ee5a1558ed34.slice/crio-3e2f17cd67cb763024d4f638f56d83e3f02a5903d3c94670570d141eb312161b WatchSource:0}: Error finding container 3e2f17cd67cb763024d4f638f56d83e3f02a5903d3c94670570d141eb312161b: Status 404 returned error can't find the container with id 3e2f17cd67cb763024d4f638f56d83e3f02a5903d3c94670570d141eb312161b Jul 16 00:41:27.177459 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.177259 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-629wb"] Jul 16 00:41:27.179880 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:27.179852 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09337c65_25e6_4f53_bced_c71b3b268363.slice/crio-afa9a351da1e3904ab39684b965c3c7e4a350afd34dc687b02544f4604823bef WatchSource:0}: Error finding container afa9a351da1e3904ab39684b965c3c7e4a350afd34dc687b02544f4604823bef: Status 404 returned error can't find the container with id afa9a351da1e3904ab39684b965c3c7e4a350afd34dc687b02544f4604823bef Jul 16 00:41:27.266325 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.266230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:27.268380 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.268355 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:41:27.279530 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.279505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aaeb25d-8cf9-49b3-8214-d742dfe94a72-metrics-certs\") pod \"network-metrics-daemon-xs9zv\" (UID: \"4aaeb25d-8cf9-49b3-8214-d742dfe94a72\") " pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:27.366967 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.366923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:27.367153 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.366979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:27.371842 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.369936 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:41:27.371982 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.371869 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:41:27.380519 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.380494 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:41:27.380519 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.380513 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48358819-a2c3-4f11-a357-37146e084dc3-original-pull-secret\") pod \"global-pull-secret-syncer-szcgm\" (UID: \"48358819-a2c3-4f11-a357-37146e084dc3\") " pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:27.391496 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.391467 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pcm\" (UniqueName: \"kubernetes.io/projected/4bbd5852-d56f-4291-9815-2f56829fb8a7-kube-api-access-k5pcm\") pod \"network-check-target-k8sjs\" (UID: \"4bbd5852-d56f-4291-9815-2f56829fb8a7\") " pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:27.417226 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.417196 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szcgm" Jul 16 00:41:27.434003 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.433979 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hn9ps\"" Jul 16 00:41:27.438250 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.438232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:27.520841 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.520770 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vmvq6\"" Jul 16 00:41:27.529015 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.528980 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs9zv" Jul 16 00:41:27.575643 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.575613 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-szcgm"] Jul 16 00:41:27.578358 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:27.578321 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48358819_a2c3_4f11_a357_37146e084dc3.slice/crio-37ef7e6132ae5f15d8426a07bb6c05e3c968f0a8f1e3a416f247d716ef870b09 WatchSource:0}: Error finding container 37ef7e6132ae5f15d8426a07bb6c05e3c968f0a8f1e3a416f247d716ef870b09: Status 404 returned error can't find the container with id 37ef7e6132ae5f15d8426a07bb6c05e3c968f0a8f1e3a416f247d716ef870b09 Jul 16 00:41:27.600782 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:27.600757 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbd5852_d56f_4291_9815_2f56829fb8a7.slice/crio-1570b4211f6b589e6c724bf6e3cb3073caedc1dfef7773af40c5cc4d1ab9378e WatchSource:0}: Error finding container 1570b4211f6b589e6c724bf6e3cb3073caedc1dfef7773af40c5cc4d1ab9378e: Status 404 returned error can't find the container with id 1570b4211f6b589e6c724bf6e3cb3073caedc1dfef7773af40c5cc4d1ab9378e Jul 16 00:41:27.602298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.602164 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8sjs"] Jul 16 00:41:27.698139 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.698040 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xs9zv"] Jul 16 00:41:27.956860 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.956791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8sjs" event={"ID":"4bbd5852-d56f-4291-9815-2f56829fb8a7","Type":"ContainerStarted","Data":"1570b4211f6b589e6c724bf6e3cb3073caedc1dfef7773af40c5cc4d1ab9378e"} Jul 16 00:41:27.958298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.958266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pdcb" event={"ID":"9ecba924-650d-46f5-a5fd-a3903bd37214","Type":"ContainerStarted","Data":"7d72805ec086a08287f80468621118581bd31adc0546a14a6cb3ee0ce7ce5aac"} Jul 16 00:41:27.960541 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.960515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xs9zv" event={"ID":"4aaeb25d-8cf9-49b3-8214-d742dfe94a72","Type":"ContainerStarted","Data":"b96b696f0785e50fc76e785e1b8ef4f6cd2bf4202e7664cb6c8d1b5238bc4244"} Jul 16 00:41:27.962102 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.962077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" event={"ID":"e41776ba-49e2-43eb-9493-ee5a1558ed34","Type":"ContainerStarted","Data":"3e2f17cd67cb763024d4f638f56d83e3f02a5903d3c94670570d141eb312161b"} Jul 16 00:41:27.963892 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.963848 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-szcgm" event={"ID":"48358819-a2c3-4f11-a357-37146e084dc3","Type":"ContainerStarted","Data":"37ef7e6132ae5f15d8426a07bb6c05e3c968f0a8f1e3a416f247d716ef870b09"} Jul 16 00:41:27.965295 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:27.965247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-629wb" event={"ID":"09337c65-25e6-4f53-bced-c71b3b268363","Type":"ContainerStarted","Data":"afa9a351da1e3904ab39684b965c3c7e4a350afd34dc687b02544f4604823bef"} Jul 16 00:41:28.972616 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:28.971604 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ecba924-650d-46f5-a5fd-a3903bd37214" containerID="7116b7c570f68ad2e1edb7b79a4c48076f951121f4131cd5bacb94fa638364f8" exitCode=0 Jul 16 00:41:28.972616 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:28.971722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pdcb" event={"ID":"9ecba924-650d-46f5-a5fd-a3903bd37214","Type":"ContainerDied","Data":"7116b7c570f68ad2e1edb7b79a4c48076f951121f4131cd5bacb94fa638364f8"} Jul 16 00:41:28.982049 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:28.981907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" event={"ID":"e41776ba-49e2-43eb-9493-ee5a1558ed34","Type":"ContainerStarted","Data":"8873695448a1b8b43a94e05d52a0b40e99dd74327146e65dba5dc6fcec7401ea"} Jul 16 00:41:28.982049 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:28.981976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" event={"ID":"e41776ba-49e2-43eb-9493-ee5a1558ed34","Type":"ContainerStarted","Data":"3e77ccacf47a28a1e4c180345b2514814f4828350d0747d47fe7a7329263101d"} Jul 16 00:41:28.982049 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:28.982006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" event={"ID":"e41776ba-49e2-43eb-9493-ee5a1558ed34","Type":"ContainerStarted","Data":"8bcb8fac8711ac1ad10834e1cc708ac615063db403f50c1d93b9b21f3d3732f1"} Jul 16 00:41:29.020870 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:29.020202 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-j8k46" podStartSLOduration=1.506799043 podStartE2EDuration="3.020166752s" totalImagesPullingTime="1.513367709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:29.019043438 +0000 UTC m=+67.941092257" watchObservedRunningTime="2026-07-16 00:41:29.020166752 +0000 UTC m=+67.942215568" Jul 16 00:41:29.923640 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:29.923322 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qf9rc" Jul 16 00:41:29.990905 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:29.990617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xs9zv" event={"ID":"4aaeb25d-8cf9-49b3-8214-d742dfe94a72","Type":"ContainerStarted","Data":"394701dcf1f5a35d7aeebef8a9b527ea00c98cdca0baed270cb9f7f7f2a40a6b"} Jul 16 00:41:29.990905 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:29.990682 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xs9zv" event={"ID":"4aaeb25d-8cf9-49b3-8214-d742dfe94a72","Type":"ContainerStarted","Data":"d1a4d040be86ba95789234e59ffe161fb83674dd313445fb25076326004b5485"} Jul 16 00:41:29.994244 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:29.994208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pdcb" event={"ID":"9ecba924-650d-46f5-a5fd-a3903bd37214","Type":"ContainerStarted","Data":"96a0bee606063a4eab71acec80d4c3d4b2c00f1beeae03f0aeee44c062048c76"} Jul 16 00:41:29.994377 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:29.994271 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pdcb" event={"ID":"9ecba924-650d-46f5-a5fd-a3903bd37214","Type":"ContainerStarted","Data":"9fbe639c3d779ccf2cf06dc3d12c85401e58f812bb45814cdb17ba5b510a31bb"} Jul 16 00:41:30.007078 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.006656 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xs9zv" podStartSLOduration=67.276345676 podStartE2EDuration="1m9.006633702s" totalImagesPullingTime="1.730288026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:30.005672292 +0000 UTC m=+68.927721112" watchObservedRunningTime="2026-07-16 00:41:30.006633702 +0000 UTC m=+68.928682519" Jul 16 00:41:30.025347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.025290 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4pdcb" podStartSLOduration=2.939623137 podStartE2EDuration="4.025275598s" totalImagesPullingTime="999.432152ms" totalInitContainerRuntime="86.220309ms" isStatefulPod=true podCreationTimestamp="2026-07-16 00:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:30.025170639 +0000 UTC m=+68.947219454" watchObservedRunningTime="2026-07-16 00:41:30.025275598 +0000 UTC m=+68.947324415" Jul 16 00:41:30.808808 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.808763 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm"] Jul 16 00:41:30.839968 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.839942 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm"] Jul 16 00:41:30.840118 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.840071 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:30.843737 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.843710 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 00:41:30.844012 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.843714 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xdxq4\"" Jul 16 00:41:30.902645 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.902611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st5zs\" (UniqueName: \"kubernetes.io/projected/a64a386d-b37b-4656-bace-89ad54e7fb0a-kube-api-access-st5zs\") pod \"monitoring-plugin-5f68df7f58-gwtnm\" (UID: \"a64a386d-b37b-4656-bace-89ad54e7fb0a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:30.902845 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:30.902666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a64a386d-b37b-4656-bace-89ad54e7fb0a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gwtnm\" (UID: \"a64a386d-b37b-4656-bace-89ad54e7fb0a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:31.003633 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:31.003286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st5zs\" (UniqueName: \"kubernetes.io/projected/a64a386d-b37b-4656-bace-89ad54e7fb0a-kube-api-access-st5zs\") pod \"monitoring-plugin-5f68df7f58-gwtnm\" (UID: \"a64a386d-b37b-4656-bace-89ad54e7fb0a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:31.003633 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:31.003338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a64a386d-b37b-4656-bace-89ad54e7fb0a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gwtnm\" (UID: \"a64a386d-b37b-4656-bace-89ad54e7fb0a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:31.007644 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:31.007595 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a64a386d-b37b-4656-bace-89ad54e7fb0a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gwtnm\" (UID: \"a64a386d-b37b-4656-bace-89ad54e7fb0a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:31.015646 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:31.015452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st5zs\" (UniqueName: \"kubernetes.io/projected/a64a386d-b37b-4656-bace-89ad54e7fb0a-kube-api-access-st5zs\") pod \"monitoring-plugin-5f68df7f58-gwtnm\" (UID: \"a64a386d-b37b-4656-bace-89ad54e7fb0a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:31.153803 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:31.153762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:33.867853 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:33.867829 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm"] Jul 16 00:41:33.872196 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:33.872156 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64a386d_b37b_4656_bace_89ad54e7fb0a.slice/crio-62ae5d56eda4829928d9e7e4dd633232dd78863d8b9eb70f4a8e146d0d6c93c9 WatchSource:0}: Error finding container 62ae5d56eda4829928d9e7e4dd633232dd78863d8b9eb70f4a8e146d0d6c93c9: Status 404 returned error can't find the container with id 62ae5d56eda4829928d9e7e4dd633232dd78863d8b9eb70f4a8e146d0d6c93c9 Jul 16 00:41:34.022908 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:34.022269 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-szcgm" event={"ID":"48358819-a2c3-4f11-a357-37146e084dc3","Type":"ContainerStarted","Data":"0b31e126650e919811dbbe24c0ca8480d68436f55935ad1d6b5c2317ae51c533"} Jul 16 00:41:34.025097 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:34.025032 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8sjs" event={"ID":"4bbd5852-d56f-4291-9815-2f56829fb8a7","Type":"ContainerStarted","Data":"95a37619a857596925c3d89f9751949294bc9af270b867e879a1a3a20f1e6a03"} Jul 16 00:41:34.025270 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:34.025101 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:41:34.026464 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:34.026435 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" event={"ID":"a64a386d-b37b-4656-bace-89ad54e7fb0a","Type":"ContainerStarted","Data":"62ae5d56eda4829928d9e7e4dd633232dd78863d8b9eb70f4a8e146d0d6c93c9"} Jul 16 00:41:34.054603 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:34.054550 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-szcgm" podStartSLOduration=66.894717824 podStartE2EDuration="1m13.054530515s" totalImagesPullingTime="6.159812691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:34.038735464 +0000 UTC m=+72.960784304" watchObservedRunningTime="2026-07-16 00:41:34.054530515 +0000 UTC m=+72.976579328" Jul 16 00:41:34.054983 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:34.054938 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k8sjs" podStartSLOduration=66.925801011 podStartE2EDuration="1m13.05492489s" totalImagesPullingTime="6.129123879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:34.054457925 +0000 UTC m=+72.976506742" watchObservedRunningTime="2026-07-16 00:41:34.05492489 +0000 UTC m=+72.976973706" Jul 16 00:41:36.035711 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.035666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" event={"ID":"a64a386d-b37b-4656-bace-89ad54e7fb0a","Type":"ContainerStarted","Data":"d1588bf0a9f3bb497deb03f34ae778440823e46277d9ea5983bd5125d2d9c2c7"} Jul 16 00:41:36.036196 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.035896 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:36.042191 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.042145 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" Jul 16 00:41:36.053414 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.053358 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwtnm" podStartSLOduration=4.674309732 podStartE2EDuration="6.053341983s" totalImagesPullingTime="1.379032251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:36.052331841 +0000 UTC m=+74.974380658" watchObservedRunningTime="2026-07-16 00:41:36.053341983 +0000 UTC m=+74.975390777" Jul 16 00:41:36.239347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.239313 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-798b54494b-54wfx"] Jul 16 00:41:36.242601 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.242576 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.245144 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.245119 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 00:41:36.245292 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.245207 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 00:41:36.245292 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.245248 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 00:41:36.245478 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.245453 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbxlk\"" Jul 16 00:41:36.245597 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.245510 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 00:41:36.245597 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.245569 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 00:41:36.257678 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.257654 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798b54494b-54wfx"] Jul 16 00:41:36.346248 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.346151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-service-ca\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.346248 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.346211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-serving-cert\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.346443 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.346298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-config\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.346443 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.346371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-oauth-serving-cert\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.346443 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.346406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ljpv\" (UniqueName: \"kubernetes.io/projected/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-kube-api-access-7ljpv\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.346669 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.346634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-oauth-config\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.447864 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.447832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ljpv\" (UniqueName: \"kubernetes.io/projected/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-kube-api-access-7ljpv\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448013 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.447874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-oauth-config\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448013 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.447919 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-service-ca\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448013 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.447942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-serving-cert\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448013 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.448002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-config\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448267 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.448037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-oauth-serving-cert\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448829 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.448769 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-service-ca\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448948 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.448916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-config\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.448948 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.448918 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-oauth-serving-cert\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.450734 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.450709 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-serving-cert\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.450847 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.450788 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-oauth-config\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.460525 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.460499 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ljpv\" (UniqueName: \"kubernetes.io/projected/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-kube-api-access-7ljpv\") pod \"console-798b54494b-54wfx\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.553908 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.553877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:41:36.714928 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:36.713522 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798b54494b-54wfx"] Jul 16 00:41:37.041167 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:37.041079 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798b54494b-54wfx" event={"ID":"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea","Type":"ContainerStarted","Data":"76136c7fb71ed48b68000798f01f956cab7f578d11e045f465f0cf1a082ba935"} Jul 16 00:41:44.039468 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.039339 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67779bd774-zs98h"] Jul 16 00:41:44.079762 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.079712 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67779bd774-zs98h"] Jul 16 00:41:44.079987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.079840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.087503 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.087473 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 00:41:44.215150 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.215119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-config\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.215434 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.215160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-oauth-config\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.215434 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.215254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-service-ca\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.215434 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.215287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-oauth-serving-cert\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.215434 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.215319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-trusted-ca-bundle\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.215434 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.215362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-serving-cert\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.215434 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.215412 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdg7j\" (UniqueName: \"kubernetes.io/projected/790ba88b-3c7d-4c3a-b0ae-16409073eef7-kube-api-access-zdg7j\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.315916 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.315830 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-service-ca\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.315916 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.315876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-oauth-serving-cert\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.316127 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-trusted-ca-bundle\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.316127 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-serving-cert\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.316127 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdg7j\" (UniqueName: \"kubernetes.io/projected/790ba88b-3c7d-4c3a-b0ae-16409073eef7-kube-api-access-zdg7j\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.316371 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-config\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.316371 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-oauth-config\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.316836 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316808 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-oauth-serving-cert\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.316836 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316829 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-service-ca\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.317027 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.316987 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-trusted-ca-bundle\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.317134 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.317114 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-config\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.318903 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.318865 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-oauth-config\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.319071 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.319051 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-serving-cert\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.330999 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.330976 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdg7j\" (UniqueName: \"kubernetes.io/projected/790ba88b-3c7d-4c3a-b0ae-16409073eef7-kube-api-access-zdg7j\") pod \"console-67779bd774-zs98h\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:44.391109 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:44.391073 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:47.091172 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.090989 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67779bd774-zs98h"] Jul 16 00:41:47.092396 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.092355 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-629wb" event={"ID":"09337c65-25e6-4f53-bced-c71b3b268363","Type":"ContainerStarted","Data":"1b6617f721322a0f64da56d5dde9c62d83a5b625d7ce78fa26cfff980c08d3d9"} Jul 16 00:41:47.092871 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.092572 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-629wb" Jul 16 00:41:47.094441 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:41:47.094405 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790ba88b_3c7d_4c3a_b0ae_16409073eef7.slice/crio-809b673a0411a333e90fd3a24ef290e7afa510436a049c4fb79701f1bb6879aa WatchSource:0}: Error finding container 809b673a0411a333e90fd3a24ef290e7afa510436a049c4fb79701f1bb6879aa: Status 404 returned error can't find the container with id 809b673a0411a333e90fd3a24ef290e7afa510436a049c4fb79701f1bb6879aa Jul 16 00:41:47.094540 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.094474 2572 patch_prober.go:28] interesting pod/downloads-68c9cbb497-629wb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" start-of-body= Jul 16 00:41:47.094540 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.094521 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-629wb" podUID="09337c65-25e6-4f53-bced-c71b3b268363" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" Jul 16 00:41:47.094781 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.094740 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798b54494b-54wfx" event={"ID":"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea","Type":"ContainerStarted","Data":"3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96"} Jul 16 00:41:47.136868 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.136799 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-629wb" podStartSLOduration=1.34163952 podStartE2EDuration="21.136782536s" totalImagesPullingTime="19.795143016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:47.136430863 +0000 UTC m=+86.058479683" watchObservedRunningTime="2026-07-16 00:41:47.136782536 +0000 UTC m=+86.058831350" Jul 16 00:41:47.169280 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:47.169232 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-798b54494b-54wfx" podStartSLOduration=0.944970934 podStartE2EDuration="11.169217054s" totalImagesPullingTime="10.22424612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:47.168732511 +0000 UTC m=+86.090781356" watchObservedRunningTime="2026-07-16 00:41:47.169217054 +0000 UTC m=+86.091265869" Jul 16 00:41:48.101832 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:48.101785 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67779bd774-zs98h" event={"ID":"790ba88b-3c7d-4c3a-b0ae-16409073eef7","Type":"ContainerStarted","Data":"ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895"} Jul 16 00:41:48.102429 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:48.101856 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67779bd774-zs98h" event={"ID":"790ba88b-3c7d-4c3a-b0ae-16409073eef7","Type":"ContainerStarted","Data":"809b673a0411a333e90fd3a24ef290e7afa510436a049c4fb79701f1bb6879aa"} Jul 16 00:41:48.114430 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:48.114393 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-629wb" Jul 16 00:41:48.122145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:48.121492 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67779bd774-zs98h" podStartSLOduration=4.121472744 podStartE2EDuration="4.121472744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:41:48.121446746 +0000 UTC m=+87.043495574" watchObservedRunningTime="2026-07-16 00:41:48.121472744 +0000 UTC m=+87.043521559" Jul 16 00:41:54.391709 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:54.391665 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:54.392276 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:54.391738 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:54.397196 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:54.397154 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:55.134950 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:55.134917 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:41:55.200777 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:55.200745 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798b54494b-54wfx"] Jul 16 00:41:56.554055 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:41:56.554018 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:42:05.033494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:05.033459 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k8sjs" Jul 16 00:42:20.230744 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.230663 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-798b54494b-54wfx" podUID="9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" containerName="console" containerID="cri-o://3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96" gracePeriod=15 Jul 16 00:42:20.527252 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.527225 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:42:20.600741 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.600700 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-oauth-config\") pod \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " Jul 16 00:42:20.600741 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.600740 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-oauth-serving-cert\") pod \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " Jul 16 00:42:20.600987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.600764 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-config\") pod \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " Jul 16 00:42:20.600987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.600787 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-service-ca\") pod \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " Jul 16 00:42:20.600987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.600815 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ljpv\" (UniqueName: \"kubernetes.io/projected/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-kube-api-access-7ljpv\") pod \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " Jul 16 00:42:20.600987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.600858 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-serving-cert\") pod \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\" (UID: \"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea\") " Jul 16 00:42:20.601259 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.601160 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-config" (OuterVolumeSpecName: "console-config") pod "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" (UID: "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:42:20.601259 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.601223 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" (UID: "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:42:20.601462 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.601363 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" (UID: "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:42:20.603219 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.603162 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" (UID: "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:42:20.603321 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.603207 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-kube-api-access-7ljpv" (OuterVolumeSpecName: "kube-api-access-7ljpv") pod "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" (UID: "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea"). InnerVolumeSpecName "kube-api-access-7ljpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:42:20.603321 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.603282 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" (UID: "9730b196-2c5f-4cf3-b9ad-4b41ef3134ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:42:20.701987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.701947 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-service-ca\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:42:20.701987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.701978 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ljpv\" (UniqueName: \"kubernetes.io/projected/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-kube-api-access-7ljpv\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:42:20.701987 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.701987 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:42:20.702247 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.702020 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-oauth-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:42:20.702247 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.702030 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-oauth-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:42:20.702247 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:20.702039 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea-console-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:42:21.223294 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.223260 2572 generic.go:356] "Generic (PLEG): container finished" podID="9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" containerID="3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96" exitCode=0 Jul 16 00:42:21.223473 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.223309 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798b54494b-54wfx" Jul 16 00:42:21.223473 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.223339 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798b54494b-54wfx" event={"ID":"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea","Type":"ContainerDied","Data":"3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96"} Jul 16 00:42:21.223473 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.223380 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798b54494b-54wfx" event={"ID":"9730b196-2c5f-4cf3-b9ad-4b41ef3134ea","Type":"ContainerDied","Data":"76136c7fb71ed48b68000798f01f956cab7f578d11e045f465f0cf1a082ba935"} Jul 16 00:42:21.223473 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.223399 2572 scope.go:117] "RemoveContainer" containerID="3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96" Jul 16 00:42:21.231890 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.231793 2572 scope.go:117] "RemoveContainer" containerID="3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96" Jul 16 00:42:21.232103 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:42:21.232063 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96\": container with ID starting with 3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96 not found: ID does not exist" containerID="3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96" Jul 16 00:42:21.232144 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.232091 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96"} err="failed to get container status \"3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96\": rpc error: code = NotFound desc = could not find container \"3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96\": container with ID starting with 3d61a1e65ff70b8d5c38d322d2b05797a9a5913aea14eafa532535529f70ff96 not found: ID does not exist" Jul 16 00:42:21.245372 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.245349 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798b54494b-54wfx"] Jul 16 00:42:21.248703 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.248682 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-798b54494b-54wfx"] Jul 16 00:42:21.600642 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:21.600607 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" path="/var/lib/kubelet/pods/9730b196-2c5f-4cf3-b9ad-4b41ef3134ea/volumes" Jul 16 00:42:50.445114 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.445072 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn"] Jul 16 00:42:50.445671 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.445468 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" containerName="console" Jul 16 00:42:50.445671 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.445484 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" containerName="console" Jul 16 00:42:50.445671 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.445547 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9730b196-2c5f-4cf3-b9ad-4b41ef3134ea" containerName="console" Jul 16 00:42:50.447972 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.447953 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.450430 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.450407 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 00:42:50.450562 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.450432 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 00:42:50.450562 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.450438 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dghrl\"" Jul 16 00:42:50.450562 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.450449 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 00:42:50.450562 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.450407 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 00:42:50.450923 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.450906 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 00:42:50.455812 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.455787 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 00:42:50.461503 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.461479 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn"] Jul 16 00:42:50.524992 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.524953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-secret-telemeter-client\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.524992 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.524996 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svf5\" (UniqueName: \"kubernetes.io/projected/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-kube-api-access-2svf5\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.525236 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.525020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-telemeter-client-tls\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.525236 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.525082 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-serving-certs-ca-bundle\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.525236 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.525103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.525236 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.525137 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-federate-client-tls\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.525236 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.525159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-metrics-client-ca\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.525395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.525259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.626525 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626485 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svf5\" (UniqueName: \"kubernetes.io/projected/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-kube-api-access-2svf5\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.626525 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-telemeter-client-tls\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.626807 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-serving-certs-ca-bundle\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.626807 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.626932 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-federate-client-tls\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.626932 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-metrics-client-ca\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.626932 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.627097 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.626965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-secret-telemeter-client\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.627436 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.627407 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-serving-certs-ca-bundle\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.627582 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.627555 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-metrics-client-ca\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.627781 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.627700 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.629686 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.629656 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-federate-client-tls\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.629780 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.629704 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-secret-telemeter-client\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.629901 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.629879 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-telemeter-client-tls\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.630028 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.630008 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.635963 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.635940 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svf5\" (UniqueName: \"kubernetes.io/projected/634bace5-bd2b-4fa4-8a1f-88fdac3903d8-kube-api-access-2svf5\") pod \"telemeter-client-66bd46f7c4-qw5gn\" (UID: \"634bace5-bd2b-4fa4-8a1f-88fdac3903d8\") " pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.759767 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.759416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" Jul 16 00:42:50.915733 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:50.915694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn"] Jul 16 00:42:51.328258 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:51.328219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" event={"ID":"634bace5-bd2b-4fa4-8a1f-88fdac3903d8","Type":"ContainerStarted","Data":"8fa06832cbd2d44301ceee008d1fb189d6ed4badf9c35a497e8cebf93cdbcf3c"} Jul 16 00:42:53.338032 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:53.337943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" event={"ID":"634bace5-bd2b-4fa4-8a1f-88fdac3903d8","Type":"ContainerStarted","Data":"b1aecaf6ce37e0c724ea7339d57c4699fe8c476797b4f3f9a756af82101ca018"} Jul 16 00:42:54.343857 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:54.343761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" event={"ID":"634bace5-bd2b-4fa4-8a1f-88fdac3903d8","Type":"ContainerStarted","Data":"285daa2f08aa8ed2e5abfe0b973e72e405344527be2b5633dca41f5ad70973c0"} Jul 16 00:42:54.343857 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:54.343835 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" event={"ID":"634bace5-bd2b-4fa4-8a1f-88fdac3903d8","Type":"ContainerStarted","Data":"cb1950cd68619e801f1e5976e5139bca61554f92cb5b6257efa7003e28c9f712"} Jul 16 00:42:54.379938 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:54.379876 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66bd46f7c4-qw5gn" podStartSLOduration=1.50480115 podStartE2EDuration="4.379859976s" totalImagesPullingTime="2.875058826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:42:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:42:54.378664907 +0000 UTC m=+153.300713746" watchObservedRunningTime="2026-07-16 00:42:54.379859976 +0000 UTC m=+153.301908790" Jul 16 00:42:55.032756 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.032718 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59bf75b969-24f2d"] Jul 16 00:42:55.034901 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.034877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.050539 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.050508 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bf75b969-24f2d"] Jul 16 00:42:55.166060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.166022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-console-config\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.166060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.166062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-service-ca\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.166298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.166149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-oauth-serving-cert\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.166298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.166224 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-trusted-ca-bundle\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.166298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.166255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-serving-cert\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.166298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.166280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c47fq\" (UniqueName: \"kubernetes.io/projected/e3d4a170-8957-438d-ada8-3877209c04d9-kube-api-access-c47fq\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.166298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.166298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-oauth-config\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.267402 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.267343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-console-config\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.267402 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.267408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-service-ca\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.267615 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.267458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-oauth-serving-cert\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.267615 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.267580 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-trusted-ca-bundle\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.267705 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.267631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-serving-cert\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.267705 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.267665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47fq\" (UniqueName: \"kubernetes.io/projected/e3d4a170-8957-438d-ada8-3877209c04d9-kube-api-access-c47fq\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.267705 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.267684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-oauth-config\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.268221 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.268168 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-console-config\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.268333 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.268254 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-oauth-serving-cert\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.268333 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.268258 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-service-ca\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.268690 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.268670 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-trusted-ca-bundle\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.270192 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.270141 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-oauth-config\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.270328 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.270311 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-serving-cert\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.275461 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.275439 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c47fq\" (UniqueName: \"kubernetes.io/projected/e3d4a170-8957-438d-ada8-3877209c04d9-kube-api-access-c47fq\") pod \"console-59bf75b969-24f2d\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.344430 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.344330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:42:55.474382 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:55.474359 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bf75b969-24f2d"] Jul 16 00:42:55.476831 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:42:55.476798 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d4a170_8957_438d_ada8_3877209c04d9.slice/crio-a5cd1bacea9b82dcbde430a0afc2adf5a8d8c3982bc721dea7d0d94d73c849f5 WatchSource:0}: Error finding container a5cd1bacea9b82dcbde430a0afc2adf5a8d8c3982bc721dea7d0d94d73c849f5: Status 404 returned error can't find the container with id a5cd1bacea9b82dcbde430a0afc2adf5a8d8c3982bc721dea7d0d94d73c849f5 Jul 16 00:42:56.352899 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:56.352861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bf75b969-24f2d" event={"ID":"e3d4a170-8957-438d-ada8-3877209c04d9","Type":"ContainerStarted","Data":"b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5"} Jul 16 00:42:56.353294 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:56.352911 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bf75b969-24f2d" event={"ID":"e3d4a170-8957-438d-ada8-3877209c04d9","Type":"ContainerStarted","Data":"a5cd1bacea9b82dcbde430a0afc2adf5a8d8c3982bc721dea7d0d94d73c849f5"} Jul 16 00:42:56.373910 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:42:56.373857 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59bf75b969-24f2d" podStartSLOduration=1.373842061 podStartE2EDuration="1.373842061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:42:56.371991617 +0000 UTC m=+155.294040456" watchObservedRunningTime="2026-07-16 00:42:56.373842061 +0000 UTC m=+155.295890876" Jul 16 00:43:05.344946 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:05.344907 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:43:05.345357 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:05.344974 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:43:05.349421 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:05.349394 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:43:05.387787 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:05.387759 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:43:05.448719 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:05.448682 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67779bd774-zs98h"] Jul 16 00:43:30.469317 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.469257 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67779bd774-zs98h" podUID="790ba88b-3c7d-4c3a-b0ae-16409073eef7" containerName="console" containerID="cri-o://ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895" gracePeriod=15 Jul 16 00:43:30.728808 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.728716 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:43:30.846553 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.846514 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-oauth-config\") pod \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " Jul 16 00:43:30.846553 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.846557 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-service-ca\") pod \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " Jul 16 00:43:30.846805 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.846602 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-serving-cert\") pod \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " Jul 16 00:43:30.846805 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.846721 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdg7j\" (UniqueName: \"kubernetes.io/projected/790ba88b-3c7d-4c3a-b0ae-16409073eef7-kube-api-access-zdg7j\") pod \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " Jul 16 00:43:30.846805 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.846782 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-trusted-ca-bundle\") pod \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " Jul 16 00:43:30.846964 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.846838 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-config\") pod \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " Jul 16 00:43:30.846964 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.846870 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-oauth-serving-cert\") pod \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\" (UID: \"790ba88b-3c7d-4c3a-b0ae-16409073eef7\") " Jul 16 00:43:30.847142 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.847113 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-service-ca" (OuterVolumeSpecName: "service-ca") pod "790ba88b-3c7d-4c3a-b0ae-16409073eef7" (UID: "790ba88b-3c7d-4c3a-b0ae-16409073eef7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:43:30.847254 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.847236 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "790ba88b-3c7d-4c3a-b0ae-16409073eef7" (UID: "790ba88b-3c7d-4c3a-b0ae-16409073eef7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:43:30.847342 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.847314 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "790ba88b-3c7d-4c3a-b0ae-16409073eef7" (UID: "790ba88b-3c7d-4c3a-b0ae-16409073eef7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:43:30.847717 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.847687 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-config" (OuterVolumeSpecName: "console-config") pod "790ba88b-3c7d-4c3a-b0ae-16409073eef7" (UID: "790ba88b-3c7d-4c3a-b0ae-16409073eef7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:43:30.848835 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.848806 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "790ba88b-3c7d-4c3a-b0ae-16409073eef7" (UID: "790ba88b-3c7d-4c3a-b0ae-16409073eef7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:43:30.848835 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.848822 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "790ba88b-3c7d-4c3a-b0ae-16409073eef7" (UID: "790ba88b-3c7d-4c3a-b0ae-16409073eef7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:43:30.848957 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.848855 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790ba88b-3c7d-4c3a-b0ae-16409073eef7-kube-api-access-zdg7j" (OuterVolumeSpecName: "kube-api-access-zdg7j") pod "790ba88b-3c7d-4c3a-b0ae-16409073eef7" (UID: "790ba88b-3c7d-4c3a-b0ae-16409073eef7"). InnerVolumeSpecName "kube-api-access-zdg7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:43:30.948381 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.948336 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-trusted-ca-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:43:30.948381 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.948369 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:43:30.948381 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.948379 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-oauth-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:43:30.948381 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.948387 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-oauth-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:43:30.948381 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.948397 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/790ba88b-3c7d-4c3a-b0ae-16409073eef7-service-ca\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:43:30.948672 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.948405 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/790ba88b-3c7d-4c3a-b0ae-16409073eef7-console-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:43:30.948672 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:30.948413 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdg7j\" (UniqueName: \"kubernetes.io/projected/790ba88b-3c7d-4c3a-b0ae-16409073eef7-kube-api-access-zdg7j\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:43:31.483326 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.483287 2572 generic.go:356] "Generic (PLEG): container finished" podID="790ba88b-3c7d-4c3a-b0ae-16409073eef7" containerID="ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895" exitCode=0 Jul 16 00:43:31.483717 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.483349 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67779bd774-zs98h" Jul 16 00:43:31.483717 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.483365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67779bd774-zs98h" event={"ID":"790ba88b-3c7d-4c3a-b0ae-16409073eef7","Type":"ContainerDied","Data":"ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895"} Jul 16 00:43:31.483717 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.483435 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67779bd774-zs98h" event={"ID":"790ba88b-3c7d-4c3a-b0ae-16409073eef7","Type":"ContainerDied","Data":"809b673a0411a333e90fd3a24ef290e7afa510436a049c4fb79701f1bb6879aa"} Jul 16 00:43:31.483717 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.483457 2572 scope.go:117] "RemoveContainer" containerID="ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895" Jul 16 00:43:31.491414 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.491393 2572 scope.go:117] "RemoveContainer" containerID="ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895" Jul 16 00:43:31.491677 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:43:31.491656 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895\": container with ID starting with ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895 not found: ID does not exist" containerID="ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895" Jul 16 00:43:31.491726 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.491685 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895"} err="failed to get container status \"ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895\": rpc error: code = NotFound desc = could not find container \"ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895\": container with ID starting with ddf3c2cf9780c1919f272ffd9f01b9c5b6a5454eaa728d58c19b52275f8c6895 not found: ID does not exist" Jul 16 00:43:31.505632 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.505610 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67779bd774-zs98h"] Jul 16 00:43:31.510477 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.510455 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67779bd774-zs98h"] Jul 16 00:43:31.600678 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:43:31.600646 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790ba88b-3c7d-4c3a-b0ae-16409073eef7" path="/var/lib/kubelet/pods/790ba88b-3c7d-4c3a-b0ae-16409073eef7/volumes" Jul 16 00:44:01.141408 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.141375 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9fff9759-zwdhw"] Jul 16 00:44:01.141874 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.141637 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790ba88b-3c7d-4c3a-b0ae-16409073eef7" containerName="console" Jul 16 00:44:01.141874 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.141648 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="790ba88b-3c7d-4c3a-b0ae-16409073eef7" containerName="console" Jul 16 00:44:01.141874 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.141693 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="790ba88b-3c7d-4c3a-b0ae-16409073eef7" containerName="console" Jul 16 00:44:01.144454 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.144433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.154412 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.154388 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9fff9759-zwdhw"] Jul 16 00:44:01.281110 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.281043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7nvq\" (UniqueName: \"kubernetes.io/projected/abf28a15-b07c-4444-8dae-22a67369c96d-kube-api-access-h7nvq\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.281319 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.281135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-trusted-ca-bundle\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.281319 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.281153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-serving-cert\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.281319 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.281211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-oauth-serving-cert\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.281319 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.281250 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-console-config\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.281456 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.281314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-oauth-config\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.281456 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.281351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-service-ca\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.382636 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.382578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-oauth-config\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.382636 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.382636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-service-ca\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.382910 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.382664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7nvq\" (UniqueName: \"kubernetes.io/projected/abf28a15-b07c-4444-8dae-22a67369c96d-kube-api-access-h7nvq\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.382910 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.382705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-trusted-ca-bundle\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.382910 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.382722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-serving-cert\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.382910 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.382741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-oauth-serving-cert\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.382910 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.382763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-console-config\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.383561 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.383534 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-service-ca\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.383677 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.383587 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-console-config\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.383677 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.383587 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-oauth-serving-cert\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.383828 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.383803 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-trusted-ca-bundle\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.385202 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.385154 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-oauth-config\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.385292 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.385257 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-serving-cert\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.394030 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.393971 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7nvq\" (UniqueName: \"kubernetes.io/projected/abf28a15-b07c-4444-8dae-22a67369c96d-kube-api-access-h7nvq\") pod \"console-6f9fff9759-zwdhw\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.453231 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.453170 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:01.583989 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.583959 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9fff9759-zwdhw"] Jul 16 00:44:01.586724 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:44:01.586700 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf28a15_b07c_4444_8dae_22a67369c96d.slice/crio-2e158c94e9744bc8df5c08a2503034952db3362dcc4f44d54ba9712e9b9dbbaf WatchSource:0}: Error finding container 2e158c94e9744bc8df5c08a2503034952db3362dcc4f44d54ba9712e9b9dbbaf: Status 404 returned error can't find the container with id 2e158c94e9744bc8df5c08a2503034952db3362dcc4f44d54ba9712e9b9dbbaf Jul 16 00:44:01.591298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:01.591274 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9fff9759-zwdhw" event={"ID":"abf28a15-b07c-4444-8dae-22a67369c96d","Type":"ContainerStarted","Data":"2e158c94e9744bc8df5c08a2503034952db3362dcc4f44d54ba9712e9b9dbbaf"} Jul 16 00:44:02.596193 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:02.596156 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9fff9759-zwdhw" event={"ID":"abf28a15-b07c-4444-8dae-22a67369c96d","Type":"ContainerStarted","Data":"e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c"} Jul 16 00:44:02.617815 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:02.617761 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9fff9759-zwdhw" podStartSLOduration=1.617746263 podStartE2EDuration="1.617746263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:02.6169973 +0000 UTC m=+221.539046133" watchObservedRunningTime="2026-07-16 00:44:02.617746263 +0000 UTC m=+221.539795078" Jul 16 00:44:11.454252 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:11.454207 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:11.454638 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:11.454292 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:11.459151 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:11.459127 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:11.629330 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:11.629293 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:44:11.679708 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:11.679673 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bf75b969-24f2d"] Jul 16 00:44:36.699975 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:36.699926 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59bf75b969-24f2d" podUID="e3d4a170-8957-438d-ada8-3877209c04d9" containerName="console" containerID="cri-o://b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5" gracePeriod=15 Jul 16 00:44:36.940846 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:36.940820 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:44:37.042980 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.042908 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-oauth-config\") pod \"e3d4a170-8957-438d-ada8-3877209c04d9\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " Jul 16 00:44:37.042980 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.042945 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-console-config\") pod \"e3d4a170-8957-438d-ada8-3877209c04d9\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " Jul 16 00:44:37.042980 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.042962 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-service-ca\") pod \"e3d4a170-8957-438d-ada8-3877209c04d9\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " Jul 16 00:44:37.042980 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.042981 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c47fq\" (UniqueName: \"kubernetes.io/projected/e3d4a170-8957-438d-ada8-3877209c04d9-kube-api-access-c47fq\") pod \"e3d4a170-8957-438d-ada8-3877209c04d9\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " Jul 16 00:44:37.043330 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.043023 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-serving-cert\") pod \"e3d4a170-8957-438d-ada8-3877209c04d9\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " Jul 16 00:44:37.043330 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.043058 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-trusted-ca-bundle\") pod \"e3d4a170-8957-438d-ada8-3877209c04d9\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " Jul 16 00:44:37.043330 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.043107 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-oauth-serving-cert\") pod \"e3d4a170-8957-438d-ada8-3877209c04d9\" (UID: \"e3d4a170-8957-438d-ada8-3877209c04d9\") " Jul 16 00:44:37.043513 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.043483 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-console-config" (OuterVolumeSpecName: "console-config") pod "e3d4a170-8957-438d-ada8-3877209c04d9" (UID: "e3d4a170-8957-438d-ada8-3877209c04d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:44:37.043565 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.043500 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3d4a170-8957-438d-ada8-3877209c04d9" (UID: "e3d4a170-8957-438d-ada8-3877209c04d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:44:37.043651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.043627 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3d4a170-8957-438d-ada8-3877209c04d9" (UID: "e3d4a170-8957-438d-ada8-3877209c04d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:44:37.043709 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.043637 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3d4a170-8957-438d-ada8-3877209c04d9" (UID: "e3d4a170-8957-438d-ada8-3877209c04d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:44:37.045138 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.045110 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3d4a170-8957-438d-ada8-3877209c04d9" (UID: "e3d4a170-8957-438d-ada8-3877209c04d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:44:37.045138 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.045130 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3d4a170-8957-438d-ada8-3877209c04d9" (UID: "e3d4a170-8957-438d-ada8-3877209c04d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:44:37.045335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.045139 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d4a170-8957-438d-ada8-3877209c04d9-kube-api-access-c47fq" (OuterVolumeSpecName: "kube-api-access-c47fq") pod "e3d4a170-8957-438d-ada8-3877209c04d9" (UID: "e3d4a170-8957-438d-ada8-3877209c04d9"). InnerVolumeSpecName "kube-api-access-c47fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:44:37.143693 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.143653 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:44:37.143693 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.143684 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-trusted-ca-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:44:37.143693 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.143694 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-oauth-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:44:37.143693 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.143702 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3d4a170-8957-438d-ada8-3877209c04d9-console-oauth-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:44:37.143947 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.143711 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-console-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:44:37.143947 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.143720 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3d4a170-8957-438d-ada8-3877209c04d9-service-ca\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:44:37.143947 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.143727 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c47fq\" (UniqueName: \"kubernetes.io/projected/e3d4a170-8957-438d-ada8-3877209c04d9-kube-api-access-c47fq\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:44:37.715092 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.715051 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3d4a170-8957-438d-ada8-3877209c04d9" containerID="b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5" exitCode=0 Jul 16 00:44:37.715472 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.715095 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bf75b969-24f2d" Jul 16 00:44:37.715472 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.715141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bf75b969-24f2d" event={"ID":"e3d4a170-8957-438d-ada8-3877209c04d9","Type":"ContainerDied","Data":"b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5"} Jul 16 00:44:37.715472 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.715208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bf75b969-24f2d" event={"ID":"e3d4a170-8957-438d-ada8-3877209c04d9","Type":"ContainerDied","Data":"a5cd1bacea9b82dcbde430a0afc2adf5a8d8c3982bc721dea7d0d94d73c849f5"} Jul 16 00:44:37.715472 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.715234 2572 scope.go:117] "RemoveContainer" containerID="b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5" Jul 16 00:44:37.723132 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.723111 2572 scope.go:117] "RemoveContainer" containerID="b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5" Jul 16 00:44:37.723454 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:44:37.723430 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5\": container with ID starting with b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5 not found: ID does not exist" containerID="b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5" Jul 16 00:44:37.723556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.723459 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5"} err="failed to get container status \"b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5\": rpc error: code = NotFound desc = could not find container \"b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5\": container with ID starting with b34aa262ce7329a6f27a437bb7e2653ee866b4594c96645bcc2405e08af8bfa5 not found: ID does not exist" Jul 16 00:44:37.733392 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.733370 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bf75b969-24f2d"] Jul 16 00:44:37.737556 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:37.737535 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59bf75b969-24f2d"] Jul 16 00:44:39.600950 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:44:39.600918 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d4a170-8957-438d-ada8-3877209c04d9" path="/var/lib/kubelet/pods/e3d4a170-8957-438d-ada8-3877209c04d9/volumes" Jul 16 00:45:03.413172 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.413131 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh"] Jul 16 00:45:03.413549 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.413416 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d4a170-8957-438d-ada8-3877209c04d9" containerName="console" Jul 16 00:45:03.413549 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.413427 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d4a170-8957-438d-ada8-3877209c04d9" containerName="console" Jul 16 00:45:03.413549 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.413476 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d4a170-8957-438d-ada8-3877209c04d9" containerName="console" Jul 16 00:45:03.416381 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.416363 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.418557 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.418532 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 00:45:03.418738 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.418721 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 00:45:03.419332 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.419314 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7vrts\"" Jul 16 00:45:03.424043 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.424009 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh"] Jul 16 00:45:03.543351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.543308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.543351 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.543348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdd87\" (UniqueName: \"kubernetes.io/projected/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-kube-api-access-zdd87\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.543580 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.543384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.644339 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.644309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.644527 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.644348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdd87\" (UniqueName: \"kubernetes.io/projected/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-kube-api-access-zdd87\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.644527 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.644397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.644676 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.644654 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.644737 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.644713 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.653410 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.653386 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdd87\" (UniqueName: \"kubernetes.io/projected/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-kube-api-access-zdd87\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.725478 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.725364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:03.852854 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:03.852823 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh"] Jul 16 00:45:03.855193 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:45:03.855152 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a64446_64a6_43b8_b9bb_fea8cfe3fb07.slice/crio-f32679706baec794396093f45344175a637ccb15d93a52d6964cb4b7f8e79b2b WatchSource:0}: Error finding container f32679706baec794396093f45344175a637ccb15d93a52d6964cb4b7f8e79b2b: Status 404 returned error can't find the container with id f32679706baec794396093f45344175a637ccb15d93a52d6964cb4b7f8e79b2b Jul 16 00:45:04.813817 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:04.813763 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" event={"ID":"47a64446-64a6-43b8-b9bb-fea8cfe3fb07","Type":"ContainerStarted","Data":"f32679706baec794396093f45344175a637ccb15d93a52d6964cb4b7f8e79b2b"} Jul 16 00:45:09.834964 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:09.834868 2572 generic.go:356] "Generic (PLEG): container finished" podID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerID="2377110e02074e37574195d8a85ef2e79923eb6788f32666cfcd589907c40c6d" exitCode=0 Jul 16 00:45:09.835484 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:09.834954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" event={"ID":"47a64446-64a6-43b8-b9bb-fea8cfe3fb07","Type":"ContainerDied","Data":"2377110e02074e37574195d8a85ef2e79923eb6788f32666cfcd589907c40c6d"} Jul 16 00:45:12.848568 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:12.848532 2572 generic.go:356] "Generic (PLEG): container finished" podID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerID="a086079ff4e0ca830aafe7a635f6378ca032e79b4cbfc8dd6ed11eaedd0f352a" exitCode=0 Jul 16 00:45:12.848952 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:12.848620 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" event={"ID":"47a64446-64a6-43b8-b9bb-fea8cfe3fb07","Type":"ContainerDied","Data":"a086079ff4e0ca830aafe7a635f6378ca032e79b4cbfc8dd6ed11eaedd0f352a"} Jul 16 00:45:19.879784 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:19.879754 2572 generic.go:356] "Generic (PLEG): container finished" podID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerID="187644fa296bdb211f157354cb7488cced55d146c44eb8dbd555645830700626" exitCode=0 Jul 16 00:45:19.880159 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:19.879810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" event={"ID":"47a64446-64a6-43b8-b9bb-fea8cfe3fb07","Type":"ContainerDied","Data":"187644fa296bdb211f157354cb7488cced55d146c44eb8dbd555645830700626"} Jul 16 00:45:21.009706 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.009683 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:21.186294 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.186207 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdd87\" (UniqueName: \"kubernetes.io/projected/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-kube-api-access-zdd87\") pod \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " Jul 16 00:45:21.186294 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.186255 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-bundle\") pod \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " Jul 16 00:45:21.186294 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.186277 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-util\") pod \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\" (UID: \"47a64446-64a6-43b8-b9bb-fea8cfe3fb07\") " Jul 16 00:45:21.186959 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.186930 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-bundle" (OuterVolumeSpecName: "bundle") pod "47a64446-64a6-43b8-b9bb-fea8cfe3fb07" (UID: "47a64446-64a6-43b8-b9bb-fea8cfe3fb07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:21.188400 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.188369 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-kube-api-access-zdd87" (OuterVolumeSpecName: "kube-api-access-zdd87") pod "47a64446-64a6-43b8-b9bb-fea8cfe3fb07" (UID: "47a64446-64a6-43b8-b9bb-fea8cfe3fb07"). InnerVolumeSpecName "kube-api-access-zdd87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:45:21.190705 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.190685 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-util" (OuterVolumeSpecName: "util") pod "47a64446-64a6-43b8-b9bb-fea8cfe3fb07" (UID: "47a64446-64a6-43b8-b9bb-fea8cfe3fb07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:21.287441 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.287409 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdd87\" (UniqueName: \"kubernetes.io/projected/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-kube-api-access-zdd87\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:21.287441 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.287436 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:21.287441 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.287446 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a64446-64a6-43b8-b9bb-fea8cfe3fb07-util\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:21.458873 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.458797 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:45:21.460971 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.460952 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:45:21.465552 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.465374 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 00:45:21.888876 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.888836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" event={"ID":"47a64446-64a6-43b8-b9bb-fea8cfe3fb07","Type":"ContainerDied","Data":"f32679706baec794396093f45344175a637ccb15d93a52d6964cb4b7f8e79b2b"} Jul 16 00:45:21.888876 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.888861 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p5cfh" Jul 16 00:45:21.891039 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:21.888892 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f32679706baec794396093f45344175a637ccb15d93a52d6964cb4b7f8e79b2b" Jul 16 00:45:26.384648 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.384618 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4"] Jul 16 00:45:26.385062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.384911 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerName="util" Jul 16 00:45:26.385062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.384923 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerName="util" Jul 16 00:45:26.385062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.384935 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerName="pull" Jul 16 00:45:26.385062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.384942 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerName="pull" Jul 16 00:45:26.385062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.384951 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerName="extract" Jul 16 00:45:26.385062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.384958 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerName="extract" Jul 16 00:45:26.385062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.385012 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="47a64446-64a6-43b8-b9bb-fea8cfe3fb07" containerName="extract" Jul 16 00:45:26.431678 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.431635 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4"] Jul 16 00:45:26.431842 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.431734 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.434921 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.434900 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 16 00:45:26.435292 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.435278 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:45:26.435441 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.435421 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lw547\"" Jul 16 00:45:26.526352 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.526308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhsvd\" (UniqueName: \"kubernetes.io/projected/1c1d9212-3e4d-45b1-9c7b-dc7806a46704-kube-api-access-jhsvd\") pod \"cert-manager-operator-controller-manager-55c444bf86-7svz4\" (UID: \"1c1d9212-3e4d-45b1-9c7b-dc7806a46704\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.526524 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.526372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c1d9212-3e4d-45b1-9c7b-dc7806a46704-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7svz4\" (UID: \"1c1d9212-3e4d-45b1-9c7b-dc7806a46704\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.627703 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.627661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhsvd\" (UniqueName: \"kubernetes.io/projected/1c1d9212-3e4d-45b1-9c7b-dc7806a46704-kube-api-access-jhsvd\") pod \"cert-manager-operator-controller-manager-55c444bf86-7svz4\" (UID: \"1c1d9212-3e4d-45b1-9c7b-dc7806a46704\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.627864 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.627722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c1d9212-3e4d-45b1-9c7b-dc7806a46704-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7svz4\" (UID: \"1c1d9212-3e4d-45b1-9c7b-dc7806a46704\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.628128 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.628108 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c1d9212-3e4d-45b1-9c7b-dc7806a46704-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7svz4\" (UID: \"1c1d9212-3e4d-45b1-9c7b-dc7806a46704\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.639117 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.639043 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhsvd\" (UniqueName: \"kubernetes.io/projected/1c1d9212-3e4d-45b1-9c7b-dc7806a46704-kube-api-access-jhsvd\") pod \"cert-manager-operator-controller-manager-55c444bf86-7svz4\" (UID: \"1c1d9212-3e4d-45b1-9c7b-dc7806a46704\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.741468 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.741426 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" Jul 16 00:45:26.893033 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.892954 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4"] Jul 16 00:45:26.896637 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:45:26.896609 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c1d9212_3e4d_45b1_9c7b_dc7806a46704.slice/crio-3c237376b7e5034c1f22b3fc979989721804005a03a20a150300e1c8293a19fc WatchSource:0}: Error finding container 3c237376b7e5034c1f22b3fc979989721804005a03a20a150300e1c8293a19fc: Status 404 returned error can't find the container with id 3c237376b7e5034c1f22b3fc979989721804005a03a20a150300e1c8293a19fc Jul 16 00:45:26.899375 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.899357 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:45:26.908025 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:26.907995 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" event={"ID":"1c1d9212-3e4d-45b1-9c7b-dc7806a46704","Type":"ContainerStarted","Data":"3c237376b7e5034c1f22b3fc979989721804005a03a20a150300e1c8293a19fc"} Jul 16 00:45:28.918946 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:28.918909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" event={"ID":"1c1d9212-3e4d-45b1-9c7b-dc7806a46704","Type":"ContainerStarted","Data":"5a09e5c6e562190d211c752d4f89289d8f79d7fbe3803e9addc148c2e3be34f3"} Jul 16 00:45:29.943644 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:29.943584 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7svz4" podStartSLOduration=2.040421107 podStartE2EDuration="3.943568194s" totalImagesPullingTime="1.903147087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:29.942044976 +0000 UTC m=+308.864093804" watchObservedRunningTime="2026-07-16 00:45:29.943568194 +0000 UTC m=+308.865617009" Jul 16 00:45:30.531883 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.531850 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w"] Jul 16 00:45:30.534130 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.534112 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.536477 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.536446 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 00:45:30.536615 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.536508 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 00:45:30.537187 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.537161 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7vrts\"" Jul 16 00:45:30.548388 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.548356 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w"] Jul 16 00:45:30.660441 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.660402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.660634 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.660529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.660634 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.660577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx4vj\" (UniqueName: \"kubernetes.io/projected/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-kube-api-access-bx4vj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.760939 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.760898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx4vj\" (UniqueName: \"kubernetes.io/projected/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-kube-api-access-bx4vj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.761107 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.760958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.761107 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.760998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.761346 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.761329 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.761399 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.761380 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.772794 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.772759 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx4vj\" (UniqueName: \"kubernetes.io/projected/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-kube-api-access-bx4vj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.843994 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.843890 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:30.978782 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:30.978753 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w"] Jul 16 00:45:30.980295 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:45:30.980268 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94dff0fd_4a9e_436f_b0ce_c00fb51aa08f.slice/crio-9426f7e2ef5a4dedb7ae06d2d97c41fe929ab901d9c9594f49c9c743c0ec6b39 WatchSource:0}: Error finding container 9426f7e2ef5a4dedb7ae06d2d97c41fe929ab901d9c9594f49c9c743c0ec6b39: Status 404 returned error can't find the container with id 9426f7e2ef5a4dedb7ae06d2d97c41fe929ab901d9c9594f49c9c743c0ec6b39 Jul 16 00:45:31.933527 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:31.933484 2572 generic.go:356] "Generic (PLEG): container finished" podID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerID="f3373530edbd8ac4c345a6b9daccb8db223d4568efc5cfda0ed7d2b9fee28c3d" exitCode=0 Jul 16 00:45:31.933752 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:31.933571 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" event={"ID":"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f","Type":"ContainerDied","Data":"f3373530edbd8ac4c345a6b9daccb8db223d4568efc5cfda0ed7d2b9fee28c3d"} Jul 16 00:45:31.933752 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:31.933625 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" event={"ID":"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f","Type":"ContainerStarted","Data":"9426f7e2ef5a4dedb7ae06d2d97c41fe929ab901d9c9594f49c9c743c0ec6b39"} Jul 16 00:45:32.055345 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.055263 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zbd54"] Jul 16 00:45:32.058202 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.058163 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.060320 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.060294 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 00:45:32.060320 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.060310 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4ll94\"" Jul 16 00:45:32.060481 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.060392 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 00:45:32.067774 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.067748 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zbd54"] Jul 16 00:45:32.173960 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.173923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f48ea16b-ae6a-4105-9852-b119585ab8b4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zbd54\" (UID: \"f48ea16b-ae6a-4105-9852-b119585ab8b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.173960 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.173964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58fq\" (UniqueName: \"kubernetes.io/projected/f48ea16b-ae6a-4105-9852-b119585ab8b4-kube-api-access-r58fq\") pod \"cert-manager-cainjector-559cdd8c87-zbd54\" (UID: \"f48ea16b-ae6a-4105-9852-b119585ab8b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.275360 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.275316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f48ea16b-ae6a-4105-9852-b119585ab8b4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zbd54\" (UID: \"f48ea16b-ae6a-4105-9852-b119585ab8b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.275360 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.275356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fq\" (UniqueName: \"kubernetes.io/projected/f48ea16b-ae6a-4105-9852-b119585ab8b4-kube-api-access-r58fq\") pod \"cert-manager-cainjector-559cdd8c87-zbd54\" (UID: \"f48ea16b-ae6a-4105-9852-b119585ab8b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.289474 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.289446 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f48ea16b-ae6a-4105-9852-b119585ab8b4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zbd54\" (UID: \"f48ea16b-ae6a-4105-9852-b119585ab8b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.289618 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.289504 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58fq\" (UniqueName: \"kubernetes.io/projected/f48ea16b-ae6a-4105-9852-b119585ab8b4-kube-api-access-r58fq\") pod \"cert-manager-cainjector-559cdd8c87-zbd54\" (UID: \"f48ea16b-ae6a-4105-9852-b119585ab8b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.378166 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.378130 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" Jul 16 00:45:32.507992 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.507964 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zbd54"] Jul 16 00:45:32.509971 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:45:32.509940 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf48ea16b_ae6a_4105_9852_b119585ab8b4.slice/crio-d1f434e97ab574ad2da5538c22f3471798886af951bde7fc2ca87905ff5b4fe7 WatchSource:0}: Error finding container d1f434e97ab574ad2da5538c22f3471798886af951bde7fc2ca87905ff5b4fe7: Status 404 returned error can't find the container with id d1f434e97ab574ad2da5538c22f3471798886af951bde7fc2ca87905ff5b4fe7 Jul 16 00:45:32.941226 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:32.941157 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" event={"ID":"f48ea16b-ae6a-4105-9852-b119585ab8b4","Type":"ContainerStarted","Data":"d1f434e97ab574ad2da5538c22f3471798886af951bde7fc2ca87905ff5b4fe7"} Jul 16 00:45:35.961968 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:35.961938 2572 generic.go:356] "Generic (PLEG): container finished" podID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerID="a0582d01f17ea9f4b96ea2e4bfe4990f04f07601d5ebe3a30cbebccecfdf81ea" exitCode=0 Jul 16 00:45:35.962406 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:35.962024 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" event={"ID":"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f","Type":"ContainerDied","Data":"a0582d01f17ea9f4b96ea2e4bfe4990f04f07601d5ebe3a30cbebccecfdf81ea"} Jul 16 00:45:35.963595 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:35.963572 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" event={"ID":"f48ea16b-ae6a-4105-9852-b119585ab8b4","Type":"ContainerStarted","Data":"1689909091c6d428bcd1da1492955bc178cb133a9f1722af1a82dab0b74676ab"} Jul 16 00:45:35.998739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:35.998683 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zbd54" podStartSLOduration=1.45476659 podStartE2EDuration="3.99866208s" totalImagesPullingTime="2.54389549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:35.997914958 +0000 UTC m=+314.919963785" watchObservedRunningTime="2026-07-16 00:45:35.99866208 +0000 UTC m=+314.920710896" Jul 16 00:45:36.970070 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:36.970037 2572 generic.go:356] "Generic (PLEG): container finished" podID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerID="d47d4fe93ba3fb39f6da1429a2740837a16da7e13e76705a057b4d320d380c52" exitCode=0 Jul 16 00:45:36.970481 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:36.970113 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" event={"ID":"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f","Type":"ContainerDied","Data":"d47d4fe93ba3fb39f6da1429a2740837a16da7e13e76705a057b4d320d380c52"} Jul 16 00:45:37.167393 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.167363 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-z26vm"] Jul 16 00:45:37.172210 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.172169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.174369 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.174350 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-j8zf8\"" Jul 16 00:45:37.179389 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.179368 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-z26vm"] Jul 16 00:45:37.209898 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.209860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73faded8-3287-4a3b-9146-fd79953c77cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-z26vm\" (UID: \"73faded8-3287-4a3b-9146-fd79953c77cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.210062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.209912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gg8j\" (UniqueName: \"kubernetes.io/projected/73faded8-3287-4a3b-9146-fd79953c77cf-kube-api-access-9gg8j\") pod \"cert-manager-webhook-6486ffd997-z26vm\" (UID: \"73faded8-3287-4a3b-9146-fd79953c77cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.310571 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.310473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73faded8-3287-4a3b-9146-fd79953c77cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-z26vm\" (UID: \"73faded8-3287-4a3b-9146-fd79953c77cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.310571 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.310527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gg8j\" (UniqueName: \"kubernetes.io/projected/73faded8-3287-4a3b-9146-fd79953c77cf-kube-api-access-9gg8j\") pod \"cert-manager-webhook-6486ffd997-z26vm\" (UID: \"73faded8-3287-4a3b-9146-fd79953c77cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.318238 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.318212 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73faded8-3287-4a3b-9146-fd79953c77cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-z26vm\" (UID: \"73faded8-3287-4a3b-9146-fd79953c77cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.318383 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.318309 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gg8j\" (UniqueName: \"kubernetes.io/projected/73faded8-3287-4a3b-9146-fd79953c77cf-kube-api-access-9gg8j\") pod \"cert-manager-webhook-6486ffd997-z26vm\" (UID: \"73faded8-3287-4a3b-9146-fd79953c77cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.481255 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.481222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.612796 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.612772 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-z26vm"] Jul 16 00:45:37.615144 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:45:37.615119 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73faded8_3287_4a3b_9146_fd79953c77cf.slice/crio-91326bc06e1df1843a3a473791f4e99a80bc79b1d2a7aee98c2ecdc1cc98314a WatchSource:0}: Error finding container 91326bc06e1df1843a3a473791f4e99a80bc79b1d2a7aee98c2ecdc1cc98314a: Status 404 returned error can't find the container with id 91326bc06e1df1843a3a473791f4e99a80bc79b1d2a7aee98c2ecdc1cc98314a Jul 16 00:45:37.976915 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.976882 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" event={"ID":"73faded8-3287-4a3b-9146-fd79953c77cf","Type":"ContainerStarted","Data":"51f309aae4eaa28e9619ff78958fd1b70171dca76a58eaedcf45c1d94bbbd6dd"} Jul 16 00:45:37.977332 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.976926 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:37.977332 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.976939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" event={"ID":"73faded8-3287-4a3b-9146-fd79953c77cf","Type":"ContainerStarted","Data":"91326bc06e1df1843a3a473791f4e99a80bc79b1d2a7aee98c2ecdc1cc98314a"} Jul 16 00:45:37.995397 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:37.995342 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" podStartSLOduration=0.995326141 podStartE2EDuration="995.326141ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:37.993508918 +0000 UTC m=+316.915557752" watchObservedRunningTime="2026-07-16 00:45:37.995326141 +0000 UTC m=+316.917374955" Jul 16 00:45:38.096853 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.096829 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:38.116203 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.116151 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-util\") pod \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " Jul 16 00:45:38.116373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.116209 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-bundle\") pod \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " Jul 16 00:45:38.116373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.116243 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx4vj\" (UniqueName: \"kubernetes.io/projected/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-kube-api-access-bx4vj\") pod \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\" (UID: \"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f\") " Jul 16 00:45:38.116689 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.116661 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-bundle" (OuterVolumeSpecName: "bundle") pod "94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" (UID: "94dff0fd-4a9e-436f-b0ce-c00fb51aa08f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:38.119381 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.119353 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-kube-api-access-bx4vj" (OuterVolumeSpecName: "kube-api-access-bx4vj") pod "94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" (UID: "94dff0fd-4a9e-436f-b0ce-c00fb51aa08f"). InnerVolumeSpecName "kube-api-access-bx4vj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:45:38.121568 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.121543 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-util" (OuterVolumeSpecName: "util") pod "94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" (UID: "94dff0fd-4a9e-436f-b0ce-c00fb51aa08f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:38.217730 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.217697 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-util\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:38.217730 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.217722 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:38.217730 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.217732 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx4vj\" (UniqueName: \"kubernetes.io/projected/94dff0fd-4a9e-436f-b0ce-c00fb51aa08f-kube-api-access-bx4vj\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:38.982824 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.982779 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" event={"ID":"94dff0fd-4a9e-436f-b0ce-c00fb51aa08f","Type":"ContainerDied","Data":"9426f7e2ef5a4dedb7ae06d2d97c41fe929ab901d9c9594f49c9c743c0ec6b39"} Jul 16 00:45:38.983261 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.982830 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fghh5w" Jul 16 00:45:38.983261 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:38.982835 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9426f7e2ef5a4dedb7ae06d2d97c41fe929ab901d9c9594f49c9c743c0ec6b39" Jul 16 00:45:40.050919 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.050886 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wdhdc"] Jul 16 00:45:40.051335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.051239 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerName="pull" Jul 16 00:45:40.051335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.051251 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerName="pull" Jul 16 00:45:40.051335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.051270 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerName="util" Jul 16 00:45:40.051335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.051284 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerName="util" Jul 16 00:45:40.051335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.051295 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerName="extract" Jul 16 00:45:40.051335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.051300 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerName="extract" Jul 16 00:45:40.051511 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.051365 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94dff0fd-4a9e-436f-b0ce-c00fb51aa08f" containerName="extract" Jul 16 00:45:40.054689 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.054673 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.058539 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.058515 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xssn4\"" Jul 16 00:45:40.068762 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.068739 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wdhdc"] Jul 16 00:45:40.133060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.133018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lcsd\" (UniqueName: \"kubernetes.io/projected/8fa39a98-445a-4a04-abf1-8eebc7180526-kube-api-access-2lcsd\") pod \"cert-manager-55b4d954d5-wdhdc\" (UID: \"8fa39a98-445a-4a04-abf1-8eebc7180526\") " pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.133060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.133066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fa39a98-445a-4a04-abf1-8eebc7180526-bound-sa-token\") pod \"cert-manager-55b4d954d5-wdhdc\" (UID: \"8fa39a98-445a-4a04-abf1-8eebc7180526\") " pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.233636 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.233597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fa39a98-445a-4a04-abf1-8eebc7180526-bound-sa-token\") pod \"cert-manager-55b4d954d5-wdhdc\" (UID: \"8fa39a98-445a-4a04-abf1-8eebc7180526\") " pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.233810 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.233696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lcsd\" (UniqueName: \"kubernetes.io/projected/8fa39a98-445a-4a04-abf1-8eebc7180526-kube-api-access-2lcsd\") pod \"cert-manager-55b4d954d5-wdhdc\" (UID: \"8fa39a98-445a-4a04-abf1-8eebc7180526\") " pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.242244 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.242208 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fa39a98-445a-4a04-abf1-8eebc7180526-bound-sa-token\") pod \"cert-manager-55b4d954d5-wdhdc\" (UID: \"8fa39a98-445a-4a04-abf1-8eebc7180526\") " pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.242444 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.242421 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lcsd\" (UniqueName: \"kubernetes.io/projected/8fa39a98-445a-4a04-abf1-8eebc7180526-kube-api-access-2lcsd\") pod \"cert-manager-55b4d954d5-wdhdc\" (UID: \"8fa39a98-445a-4a04-abf1-8eebc7180526\") " pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.363443 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.363416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wdhdc" Jul 16 00:45:40.493925 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.493901 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wdhdc"] Jul 16 00:45:40.496060 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:45:40.496037 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fa39a98_445a_4a04_abf1_8eebc7180526.slice/crio-f5b38172d3621574f7421119e23c4d8a488bc81e8a046b5dc2627e02d9bfe122 WatchSource:0}: Error finding container f5b38172d3621574f7421119e23c4d8a488bc81e8a046b5dc2627e02d9bfe122: Status 404 returned error can't find the container with id f5b38172d3621574f7421119e23c4d8a488bc81e8a046b5dc2627e02d9bfe122 Jul 16 00:45:40.992952 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.992906 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wdhdc" event={"ID":"8fa39a98-445a-4a04-abf1-8eebc7180526","Type":"ContainerStarted","Data":"624abe3e503e6d9748d8419e957a3ede8a0ea5e9328c16882922ff882083e9d3"} Jul 16 00:45:40.992952 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:40.992958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wdhdc" event={"ID":"8fa39a98-445a-4a04-abf1-8eebc7180526","Type":"ContainerStarted","Data":"f5b38172d3621574f7421119e23c4d8a488bc81e8a046b5dc2627e02d9bfe122"} Jul 16 00:45:41.008914 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:41.008866 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wdhdc" podStartSLOduration=1.008851525 podStartE2EDuration="1.008851525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:41.006972452 +0000 UTC m=+319.929021292" watchObservedRunningTime="2026-07-16 00:45:41.008851525 +0000 UTC m=+319.930900339" Jul 16 00:45:43.985746 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:43.985711 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-z26vm" Jul 16 00:45:52.715813 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.715777 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj"] Jul 16 00:45:52.719950 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.719928 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.722062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.722035 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 00:45:52.722062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.722058 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7vrts\"" Jul 16 00:45:52.722242 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.722149 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 00:45:52.728357 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.728330 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj"] Jul 16 00:45:52.829595 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.829558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.829751 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.829685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2crt\" (UniqueName: \"kubernetes.io/projected/7fa13c93-4122-4ee3-a84f-fc439e57671b-kube-api-access-s2crt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.829797 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.829741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.931020 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.930984 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2crt\" (UniqueName: \"kubernetes.io/projected/7fa13c93-4122-4ee3-a84f-fc439e57671b-kube-api-access-s2crt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.931227 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.931024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.931227 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.931085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.931549 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.931525 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.931592 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.931548 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:52.940647 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:52.940609 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2crt\" (UniqueName: \"kubernetes.io/projected/7fa13c93-4122-4ee3-a84f-fc439e57671b-kube-api-access-s2crt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:53.030567 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:53.030464 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:53.164413 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:53.164381 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj"] Jul 16 00:45:53.167118 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:45:53.167088 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa13c93_4122_4ee3_a84f_fc439e57671b.slice/crio-a4e556fb3f20e0e50748481822add4fb687317094f6d217103bf6b5fe06a8b2c WatchSource:0}: Error finding container a4e556fb3f20e0e50748481822add4fb687317094f6d217103bf6b5fe06a8b2c: Status 404 returned error can't find the container with id a4e556fb3f20e0e50748481822add4fb687317094f6d217103bf6b5fe06a8b2c Jul 16 00:45:54.055198 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:54.055140 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerID="1115de60e5fa19678532b00fee16b0dd3cb7df69b584fd82a43b170437e805eb" exitCode=0 Jul 16 00:45:54.055564 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:54.055231 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" event={"ID":"7fa13c93-4122-4ee3-a84f-fc439e57671b","Type":"ContainerDied","Data":"1115de60e5fa19678532b00fee16b0dd3cb7df69b584fd82a43b170437e805eb"} Jul 16 00:45:54.055564 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:54.055283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" event={"ID":"7fa13c93-4122-4ee3-a84f-fc439e57671b","Type":"ContainerStarted","Data":"a4e556fb3f20e0e50748481822add4fb687317094f6d217103bf6b5fe06a8b2c"} Jul 16 00:45:55.061877 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:55.061738 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerID="2123e415874fd3f40a38c8fe58b5bb01971d824c565f3a722da3bd3cb24ad86b" exitCode=0 Jul 16 00:45:55.061877 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:55.061797 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" event={"ID":"7fa13c93-4122-4ee3-a84f-fc439e57671b","Type":"ContainerDied","Data":"2123e415874fd3f40a38c8fe58b5bb01971d824c565f3a722da3bd3cb24ad86b"} Jul 16 00:45:56.067812 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:56.067774 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerID="1a6a13899474746bf39f3f44ab0cebc2819ef591f19c1ca23a19853282a8e6da" exitCode=0 Jul 16 00:45:56.068206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:56.067861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" event={"ID":"7fa13c93-4122-4ee3-a84f-fc439e57671b","Type":"ContainerDied","Data":"1a6a13899474746bf39f3f44ab0cebc2819ef591f19c1ca23a19853282a8e6da"} Jul 16 00:45:57.199163 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.199137 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:57.266147 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.266114 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-util\") pod \"7fa13c93-4122-4ee3-a84f-fc439e57671b\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " Jul 16 00:45:57.266311 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.266167 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2crt\" (UniqueName: \"kubernetes.io/projected/7fa13c93-4122-4ee3-a84f-fc439e57671b-kube-api-access-s2crt\") pod \"7fa13c93-4122-4ee3-a84f-fc439e57671b\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " Jul 16 00:45:57.266311 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.266216 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-bundle\") pod \"7fa13c93-4122-4ee3-a84f-fc439e57671b\" (UID: \"7fa13c93-4122-4ee3-a84f-fc439e57671b\") " Jul 16 00:45:57.266997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.266974 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-bundle" (OuterVolumeSpecName: "bundle") pod "7fa13c93-4122-4ee3-a84f-fc439e57671b" (UID: "7fa13c93-4122-4ee3-a84f-fc439e57671b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:57.268309 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.268288 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa13c93-4122-4ee3-a84f-fc439e57671b-kube-api-access-s2crt" (OuterVolumeSpecName: "kube-api-access-s2crt") pod "7fa13c93-4122-4ee3-a84f-fc439e57671b" (UID: "7fa13c93-4122-4ee3-a84f-fc439e57671b"). InnerVolumeSpecName "kube-api-access-s2crt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:45:57.271603 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.271562 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-util" (OuterVolumeSpecName: "util") pod "7fa13c93-4122-4ee3-a84f-fc439e57671b" (UID: "7fa13c93-4122-4ee3-a84f-fc439e57671b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:57.366822 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.366787 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-util\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:57.366822 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.366821 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2crt\" (UniqueName: \"kubernetes.io/projected/7fa13c93-4122-4ee3-a84f-fc439e57671b-kube-api-access-s2crt\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:57.367009 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:57.366832 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fa13c93-4122-4ee3-a84f-fc439e57671b-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:45:58.078165 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:58.078132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" event={"ID":"7fa13c93-4122-4ee3-a84f-fc439e57671b","Type":"ContainerDied","Data":"a4e556fb3f20e0e50748481822add4fb687317094f6d217103bf6b5fe06a8b2c"} Jul 16 00:45:58.078165 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:58.078162 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv7rlj" Jul 16 00:45:58.078388 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:45:58.078192 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4e556fb3f20e0e50748481822add4fb687317094f6d217103bf6b5fe06a8b2c" Jul 16 00:46:01.384211 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384160 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq"] Jul 16 00:46:01.384579 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384447 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerName="util" Jul 16 00:46:01.384579 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384459 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerName="util" Jul 16 00:46:01.384579 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384465 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerName="extract" Jul 16 00:46:01.384579 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384470 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerName="extract" Jul 16 00:46:01.384579 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384479 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerName="pull" Jul 16 00:46:01.384579 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384486 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerName="pull" Jul 16 00:46:01.384579 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.384535 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa13c93-4122-4ee3-a84f-fc439e57671b" containerName="extract" Jul 16 00:46:01.388447 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.388427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.390589 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.390563 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 00:46:01.390741 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.390721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 00:46:01.391266 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.391187 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 00:46:01.391266 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.391172 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 00:46:01.391392 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.391276 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:46:01.391490 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.391475 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-64qvf\"" Jul 16 00:46:01.407197 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.403741 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq"] Jul 16 00:46:01.498126 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.498077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/862d1d1c-bb15-40ea-80bf-c0ee83215340-metrics-cert\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.498126 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.498132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk9jg\" (UniqueName: \"kubernetes.io/projected/862d1d1c-bb15-40ea-80bf-c0ee83215340-kube-api-access-rk9jg\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.498380 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.498173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/862d1d1c-bb15-40ea-80bf-c0ee83215340-manager-config\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.498380 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.498278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/862d1d1c-bb15-40ea-80bf-c0ee83215340-cert\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.598692 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.598661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/862d1d1c-bb15-40ea-80bf-c0ee83215340-metrics-cert\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.598864 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.598701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk9jg\" (UniqueName: \"kubernetes.io/projected/862d1d1c-bb15-40ea-80bf-c0ee83215340-kube-api-access-rk9jg\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.598864 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.598731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/862d1d1c-bb15-40ea-80bf-c0ee83215340-manager-config\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.598864 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.598757 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/862d1d1c-bb15-40ea-80bf-c0ee83215340-cert\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.599548 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.599517 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/862d1d1c-bb15-40ea-80bf-c0ee83215340-manager-config\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.601616 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.601592 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/862d1d1c-bb15-40ea-80bf-c0ee83215340-cert\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.601729 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.601679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/862d1d1c-bb15-40ea-80bf-c0ee83215340-metrics-cert\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.607379 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.607356 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk9jg\" (UniqueName: \"kubernetes.io/projected/862d1d1c-bb15-40ea-80bf-c0ee83215340-kube-api-access-rk9jg\") pod \"lws-controller-manager-c857fdb5b-g4trq\" (UID: \"862d1d1c-bb15-40ea-80bf-c0ee83215340\") " pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.697570 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.697484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:01.864044 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:01.864018 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq"] Jul 16 00:46:01.866122 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:46:01.866095 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862d1d1c_bb15_40ea_80bf_c0ee83215340.slice/crio-2b3e6781f71a0b751b66eecc8fda5c62d51e2d08e67200760a80fc5234b63259 WatchSource:0}: Error finding container 2b3e6781f71a0b751b66eecc8fda5c62d51e2d08e67200760a80fc5234b63259: Status 404 returned error can't find the container with id 2b3e6781f71a0b751b66eecc8fda5c62d51e2d08e67200760a80fc5234b63259 Jul 16 00:46:02.097216 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:02.097163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" event={"ID":"862d1d1c-bb15-40ea-80bf-c0ee83215340","Type":"ContainerStarted","Data":"2b3e6781f71a0b751b66eecc8fda5c62d51e2d08e67200760a80fc5234b63259"} Jul 16 00:46:06.116569 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:06.116531 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" event={"ID":"862d1d1c-bb15-40ea-80bf-c0ee83215340","Type":"ContainerStarted","Data":"6f2da37f99beb70f5e742da0f1e0ddb5c2e68857a29473e81b2280011c840c55"} Jul 16 00:46:06.117012 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:06.116637 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:09.589646 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.589588 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" podStartSLOduration=5.135013939 podStartE2EDuration="8.589567171s" totalImagesPullingTime="3.454553232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:46:06.137228866 +0000 UTC m=+345.059277683" watchObservedRunningTime="2026-07-16 00:46:09.589567171 +0000 UTC m=+348.511615985" Jul 16 00:46:09.591282 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.591250 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8"] Jul 16 00:46:09.595682 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.595658 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.597821 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.597795 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 00:46:09.597821 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.597813 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 00:46:09.598048 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.597798 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9kszx\"" Jul 16 00:46:09.598103 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.598056 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 00:46:09.598211 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.598159 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 00:46:09.616934 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.616906 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8"] Jul 16 00:46:09.676778 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.676743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-manifests\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.676778 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.676781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-tmp\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.676968 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.676804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.676968 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.676858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.676968 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.676898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wr9k\" (UniqueName: \"kubernetes.io/projected/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-kube-api-access-2wr9k\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.777696 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.777659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-manifests\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.777889 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.777708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-tmp\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.777889 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.777734 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.777889 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.777767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.777889 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.777808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr9k\" (UniqueName: \"kubernetes.io/projected/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-kube-api-access-2wr9k\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.778090 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.778066 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-manifests\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.780228 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.780198 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-tmp\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.780228 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.780217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.780387 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.780371 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.788642 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.788616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wr9k\" (UniqueName: \"kubernetes.io/projected/62d4b692-f260-4c61-97cb-89fa4cfdc6fe-kube-api-access-2wr9k\") pod \"opendatahub-operator-controller-manager-5cf8c55d45-2n5p8\" (UID: \"62d4b692-f260-4c61-97cb-89fa4cfdc6fe\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:09.908236 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:09.908186 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:10.044457 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:10.044368 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8"] Jul 16 00:46:10.135847 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:10.135808 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" event={"ID":"62d4b692-f260-4c61-97cb-89fa4cfdc6fe","Type":"ContainerStarted","Data":"a7df0cbd696a09b3669b8308d869ce9a75f20fcfb0405d68f241eecbf5e2021b"} Jul 16 00:46:14.156433 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:14.156388 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" event={"ID":"62d4b692-f260-4c61-97cb-89fa4cfdc6fe","Type":"ContainerStarted","Data":"3a134c84bf44662e4e62e033acad80a0b90bd0e929c55ce30b12e69bda85d024"} Jul 16 00:46:15.162143 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:15.162112 2572 generic.go:356] "Generic (PLEG): container finished" podID="62d4b692-f260-4c61-97cb-89fa4cfdc6fe" containerID="3a134c84bf44662e4e62e033acad80a0b90bd0e929c55ce30b12e69bda85d024" exitCode=0 Jul 16 00:46:15.162551 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:15.162187 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" event={"ID":"62d4b692-f260-4c61-97cb-89fa4cfdc6fe","Type":"ContainerDied","Data":"3a134c84bf44662e4e62e033acad80a0b90bd0e929c55ce30b12e69bda85d024"} Jul 16 00:46:16.168325 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:16.168290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" event={"ID":"62d4b692-f260-4c61-97cb-89fa4cfdc6fe","Type":"ContainerStarted","Data":"ffbc069ec2086334b6588a1139bb4c0299b573a16a596b95757682dc513679a2"} Jul 16 00:46:16.168694 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:16.168434 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:16.199876 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:16.199822 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" podStartSLOduration=2.716751049 podStartE2EDuration="7.199806715s" totalImagesPullingTime="3.477731543s" totalInitContainerRuntime="1.005324123s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:46:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:46:16.19841238 +0000 UTC m=+355.120461216" watchObservedRunningTime="2026-07-16 00:46:16.199806715 +0000 UTC m=+355.121855573" Jul 16 00:46:17.125197 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:17.125141 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c857fdb5b-g4trq" Jul 16 00:46:27.175007 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:27.174975 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf8c55d45-2n5p8" Jul 16 00:46:38.651402 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.651367 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4"] Jul 16 00:46:38.661085 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.661056 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.664903 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.664873 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 00:46:38.666369 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.666343 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 00:46:38.666499 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.666378 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 00:46:38.666499 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.666398 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lggwx\"" Jul 16 00:46:38.667081 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.667063 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 00:46:38.667447 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.667428 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 00:46:38.671855 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.671839 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 00:46:38.682984 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.682955 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4"] Jul 16 00:46:38.712029 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.711996 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.712230 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.712034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clgqf\" (UniqueName: \"kubernetes.io/projected/851a917f-7ecc-4739-a60f-23bcae2c6cac-kube-api-access-clgqf\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.712230 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.712075 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.712230 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.712159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.712349 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.712244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.712349 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.712269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.712349 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.712302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/851a917f-7ecc-4739-a60f-23bcae2c6cac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.813540 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.813485 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.813739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.813554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.813739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.813584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.813739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.813625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/851a917f-7ecc-4739-a60f-23bcae2c6cac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.813739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.813651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.813739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.813690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clgqf\" (UniqueName: \"kubernetes.io/projected/851a917f-7ecc-4739-a60f-23bcae2c6cac-kube-api-access-clgqf\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.813739 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.813724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.814345 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.814319 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.815977 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.815958 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.816060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.815994 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.816233 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.816213 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/851a917f-7ecc-4739-a60f-23bcae2c6cac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.816346 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.816331 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.825543 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.825521 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851a917f-7ecc-4739-a60f-23bcae2c6cac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.827353 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.827331 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clgqf\" (UniqueName: \"kubernetes.io/projected/851a917f-7ecc-4739-a60f-23bcae2c6cac-kube-api-access-clgqf\") pod \"istiod-openshift-gateway-94bb8fbfd-fqxs4\" (UID: \"851a917f-7ecc-4739-a60f-23bcae2c6cac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:38.971256 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:38.971155 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:39.160891 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:39.160684 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4"] Jul 16 00:46:39.165025 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:46:39.164995 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851a917f_7ecc_4739_a60f_23bcae2c6cac.slice/crio-1b514b0cbc6c9daf26d6199764862acb70bde735d0712f614317d5dc4d8d7ac0 WatchSource:0}: Error finding container 1b514b0cbc6c9daf26d6199764862acb70bde735d0712f614317d5dc4d8d7ac0: Status 404 returned error can't find the container with id 1b514b0cbc6c9daf26d6199764862acb70bde735d0712f614317d5dc4d8d7ac0 Jul 16 00:46:39.281997 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:39.281904 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" event={"ID":"851a917f-7ecc-4739-a60f-23bcae2c6cac","Type":"ContainerStarted","Data":"1b514b0cbc6c9daf26d6199764862acb70bde735d0712f614317d5dc4d8d7ac0"} Jul 16 00:46:41.689897 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:41.689855 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 16 00:46:41.690301 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:41.689966 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 16 00:46:42.303854 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:42.303820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" event={"ID":"851a917f-7ecc-4739-a60f-23bcae2c6cac","Type":"ContainerStarted","Data":"1911cf3921b26d4a03654e1c898796bea3a890956fdfe76d828258145dc1fbb5"} Jul 16 00:46:42.304028 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:42.303970 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:46:42.305795 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:42.305762 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-fqxs4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 00:46:42.305919 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:42.305832 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" podUID="851a917f-7ecc-4739-a60f-23bcae2c6cac" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:46:42.387106 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:42.387037 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" podStartSLOduration=1.864488475 podStartE2EDuration="4.387015726s" totalImagesPullingTime="2.522527251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:46:42.383677015 +0000 UTC m=+381.305725830" watchObservedRunningTime="2026-07-16 00:46:42.387015726 +0000 UTC m=+381.309064544" Jul 16 00:46:43.309686 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:43.309657 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-fqxs4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 00:46:43.310032 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:43.309706 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" podUID="851a917f-7ecc-4739-a60f-23bcae2c6cac" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:46:46.310237 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:46:46.310204 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fqxs4" Jul 16 00:47:42.914298 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.914261 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb"] Jul 16 00:47:42.917713 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.917696 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:42.921793 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.921769 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tcss8\"" Jul 16 00:47:42.921940 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.921772 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 00:47:42.921940 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.921771 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 00:47:42.927062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.927037 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb"] Jul 16 00:47:42.935019 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.934984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:42.935214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.935032 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lw4z\" (UniqueName: \"kubernetes.io/projected/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-kube-api-access-5lw4z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:42.935214 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:42.935060 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.036466 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.036426 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.036643 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.036477 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lw4z\" (UniqueName: \"kubernetes.io/projected/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-kube-api-access-5lw4z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.036687 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.036660 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.036851 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.036833 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.036990 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.036970 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.045642 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.045608 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lw4z\" (UniqueName: \"kubernetes.io/projected/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-kube-api-access-5lw4z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.227485 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.227371 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:43.363098 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.363073 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb"] Jul 16 00:47:43.365646 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:47:43.365618 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4511f56_5d6d_48bb_a0e9_42eb4aa66ff9.slice/crio-10e455265f8022e8af56688ab7bd214904131c17462ea2f108189927e0d5959a WatchSource:0}: Error finding container 10e455265f8022e8af56688ab7bd214904131c17462ea2f108189927e0d5959a: Status 404 returned error can't find the container with id 10e455265f8022e8af56688ab7bd214904131c17462ea2f108189927e0d5959a Jul 16 00:47:43.512394 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.512322 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw"] Jul 16 00:47:43.515589 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.515570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.523528 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.523503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw"] Jul 16 00:47:43.541347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.541317 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.541547 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.541359 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.541547 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.541457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5kl4\" (UniqueName: \"kubernetes.io/projected/6ec844ee-2169-465a-9df7-c513e1c90a87-kube-api-access-h5kl4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.581800 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.581767 2572 generic.go:356] "Generic (PLEG): container finished" podID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerID="aaa2d11454b30b43ae6b05cc2ccbeaf02c8113db1071c6b25cbf5ffa33e73a3b" exitCode=0 Jul 16 00:47:43.581950 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.581832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" event={"ID":"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9","Type":"ContainerDied","Data":"aaa2d11454b30b43ae6b05cc2ccbeaf02c8113db1071c6b25cbf5ffa33e73a3b"} Jul 16 00:47:43.581950 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.581873 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" event={"ID":"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9","Type":"ContainerStarted","Data":"10e455265f8022e8af56688ab7bd214904131c17462ea2f108189927e0d5959a"} Jul 16 00:47:43.642173 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.642134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5kl4\" (UniqueName: \"kubernetes.io/projected/6ec844ee-2169-465a-9df7-c513e1c90a87-kube-api-access-h5kl4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.642411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.642302 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.642411 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.642348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.642838 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.642816 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.642888 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.642812 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.650597 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.650562 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5kl4\" (UniqueName: \"kubernetes.io/projected/6ec844ee-2169-465a-9df7-c513e1c90a87-kube-api-access-h5kl4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.832116 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.832018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:43.971573 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:43.971539 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw"] Jul 16 00:47:43.974487 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:47:43.974453 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec844ee_2169_465a_9df7_c513e1c90a87.slice/crio-ea837103d1407e2d58184fa2fa8a1954a51e054daad75e49e052032a0f31043d WatchSource:0}: Error finding container ea837103d1407e2d58184fa2fa8a1954a51e054daad75e49e052032a0f31043d: Status 404 returned error can't find the container with id ea837103d1407e2d58184fa2fa8a1954a51e054daad75e49e052032a0f31043d Jul 16 00:47:44.136238 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.136203 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl"] Jul 16 00:47:44.139695 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.139676 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.146320 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.146073 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.146320 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.146144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7pg7\" (UniqueName: \"kubernetes.io/projected/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-kube-api-access-w7pg7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.146320 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.146239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.149115 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.149082 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl"] Jul 16 00:47:44.247395 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.247353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7pg7\" (UniqueName: \"kubernetes.io/projected/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-kube-api-access-w7pg7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.247596 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.247411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.247596 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.247466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.247781 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.247764 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.247849 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.247802 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.256378 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.256353 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7pg7\" (UniqueName: \"kubernetes.io/projected/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-kube-api-access-w7pg7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.452387 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.452337 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:44.588806 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.588764 2572 generic.go:356] "Generic (PLEG): container finished" podID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerID="89cfaad3e9a0cf4155879a9e4ae2614494bc0db1e04e503689f89a4e80b90b4c" exitCode=0 Jul 16 00:47:44.588965 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.588845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" event={"ID":"6ec844ee-2169-465a-9df7-c513e1c90a87","Type":"ContainerDied","Data":"89cfaad3e9a0cf4155879a9e4ae2614494bc0db1e04e503689f89a4e80b90b4c"} Jul 16 00:47:44.588965 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.588903 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" event={"ID":"6ec844ee-2169-465a-9df7-c513e1c90a87","Type":"ContainerStarted","Data":"ea837103d1407e2d58184fa2fa8a1954a51e054daad75e49e052032a0f31043d"} Jul 16 00:47:44.591234 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.591171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" event={"ID":"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9","Type":"ContainerStarted","Data":"f5329374aa2a28aa96d1c74cf5c6d7e5dd288bb7212e042273cee6ae43332c72"} Jul 16 00:47:44.594732 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.594710 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl"] Jul 16 00:47:44.637200 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:47:44.637142 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ada6c2_90b9_414d_9eb5_d6c87fa482dd.slice/crio-0a7e27410a8b84ae47f0e9464eac34e40fb49a5ad109af5e27f40755062c99af WatchSource:0}: Error finding container 0a7e27410a8b84ae47f0e9464eac34e40fb49a5ad109af5e27f40755062c99af: Status 404 returned error can't find the container with id 0a7e27410a8b84ae47f0e9464eac34e40fb49a5ad109af5e27f40755062c99af Jul 16 00:47:44.721798 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.721708 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t"] Jul 16 00:47:44.725329 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.725303 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.736470 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.736443 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t"] Jul 16 00:47:44.753108 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.753067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf5gs\" (UniqueName: \"kubernetes.io/projected/4f7e4188-1da6-41a0-8cb3-03fb573facf0-kube-api-access-zf5gs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.753314 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.753170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.753314 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.753269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.854471 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.854411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.854471 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.854482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.854690 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.854518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf5gs\" (UniqueName: \"kubernetes.io/projected/4f7e4188-1da6-41a0-8cb3-03fb573facf0-kube-api-access-zf5gs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.854916 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.854891 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.854954 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.854901 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:44.864467 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:44.864437 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf5gs\" (UniqueName: \"kubernetes.io/projected/4f7e4188-1da6-41a0-8cb3-03fb573facf0-kube-api-access-zf5gs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:45.035645 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.035553 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:45.173482 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.173455 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t"] Jul 16 00:47:45.189118 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:47:45.189087 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7e4188_1da6_41a0_8cb3_03fb573facf0.slice/crio-27faa727bba89c9977cdce224f141f61fe6479e53f793f2b0188479776d3165f WatchSource:0}: Error finding container 27faa727bba89c9977cdce224f141f61fe6479e53f793f2b0188479776d3165f: Status 404 returned error can't find the container with id 27faa727bba89c9977cdce224f141f61fe6479e53f793f2b0188479776d3165f Jul 16 00:47:45.598401 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.598371 2572 generic.go:356] "Generic (PLEG): container finished" podID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerID="f5329374aa2a28aa96d1c74cf5c6d7e5dd288bb7212e042273cee6ae43332c72" exitCode=0 Jul 16 00:47:45.600409 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.600381 2572 generic.go:356] "Generic (PLEG): container finished" podID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerID="44f931e99cccef1ba17fc06b692ff48cd2f7f2315733df232558848978891263" exitCode=0 Jul 16 00:47:45.601948 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.601924 2572 generic.go:356] "Generic (PLEG): container finished" podID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerID="f9265213c6678cb8b6ac4f094c4f545ee2fa148a82e821b70a9e4b0beb8d4a80" exitCode=0 Jul 16 00:47:45.603312 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.603282 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" event={"ID":"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9","Type":"ContainerDied","Data":"f5329374aa2a28aa96d1c74cf5c6d7e5dd288bb7212e042273cee6ae43332c72"} Jul 16 00:47:45.603424 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.603334 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" event={"ID":"6ec844ee-2169-465a-9df7-c513e1c90a87","Type":"ContainerDied","Data":"44f931e99cccef1ba17fc06b692ff48cd2f7f2315733df232558848978891263"} Jul 16 00:47:45.603424 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.603358 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" event={"ID":"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd","Type":"ContainerDied","Data":"f9265213c6678cb8b6ac4f094c4f545ee2fa148a82e821b70a9e4b0beb8d4a80"} Jul 16 00:47:45.603424 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.603374 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" event={"ID":"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd","Type":"ContainerStarted","Data":"0a7e27410a8b84ae47f0e9464eac34e40fb49a5ad109af5e27f40755062c99af"} Jul 16 00:47:45.603764 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.603740 2572 generic.go:356] "Generic (PLEG): container finished" podID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerID="d5afe0a84e6d26ae77165070fecebfa97ada761b7c7205a237852e7e4d36cfd0" exitCode=0 Jul 16 00:47:45.603866 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.603793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" event={"ID":"4f7e4188-1da6-41a0-8cb3-03fb573facf0","Type":"ContainerDied","Data":"d5afe0a84e6d26ae77165070fecebfa97ada761b7c7205a237852e7e4d36cfd0"} Jul 16 00:47:45.603866 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:45.603829 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" event={"ID":"4f7e4188-1da6-41a0-8cb3-03fb573facf0","Type":"ContainerStarted","Data":"27faa727bba89c9977cdce224f141f61fe6479e53f793f2b0188479776d3165f"} Jul 16 00:47:46.616801 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:46.616773 2572 generic.go:356] "Generic (PLEG): container finished" podID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerID="24bcdbd7f08acc671310fd1d01f19daf2ac257c4deb1e2c4b6f3c98ac2f68705" exitCode=0 Jul 16 00:47:46.617156 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:46.616851 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" event={"ID":"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9","Type":"ContainerDied","Data":"24bcdbd7f08acc671310fd1d01f19daf2ac257c4deb1e2c4b6f3c98ac2f68705"} Jul 16 00:47:46.619110 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:46.619083 2572 generic.go:356] "Generic (PLEG): container finished" podID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerID="4e0894240b229ca5dff3d7a7715e1d053dd68d355b9b9a6586f51a0e378a4411" exitCode=0 Jul 16 00:47:46.619230 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:46.619155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" event={"ID":"6ec844ee-2169-465a-9df7-c513e1c90a87","Type":"ContainerDied","Data":"4e0894240b229ca5dff3d7a7715e1d053dd68d355b9b9a6586f51a0e378a4411"} Jul 16 00:47:46.621053 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:46.621031 2572 generic.go:356] "Generic (PLEG): container finished" podID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerID="4685c9435f075603d8ffda6d6f96be4620f676fc1e1d47f5f73396ac95ab6868" exitCode=0 Jul 16 00:47:46.621140 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:46.621108 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" event={"ID":"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd","Type":"ContainerDied","Data":"4685c9435f075603d8ffda6d6f96be4620f676fc1e1d47f5f73396ac95ab6868"} Jul 16 00:47:47.628359 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.628326 2572 generic.go:356] "Generic (PLEG): container finished" podID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerID="7e512043c5d9e787382cab4cb4e53d954565a9645118ae2c88ad2d034e255c11" exitCode=0 Jul 16 00:47:47.628833 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.628409 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" event={"ID":"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd","Type":"ContainerDied","Data":"7e512043c5d9e787382cab4cb4e53d954565a9645118ae2c88ad2d034e255c11"} Jul 16 00:47:47.630235 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.630206 2572 generic.go:356] "Generic (PLEG): container finished" podID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerID="02181ad96b71995d1ca18000f3d55a30acbd6f81f351f3d87f6170e1541ab6a4" exitCode=0 Jul 16 00:47:47.630354 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.630331 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" event={"ID":"4f7e4188-1da6-41a0-8cb3-03fb573facf0","Type":"ContainerDied","Data":"02181ad96b71995d1ca18000f3d55a30acbd6f81f351f3d87f6170e1541ab6a4"} Jul 16 00:47:47.778266 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.778242 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:47.846614 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.846584 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:47.882335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.882249 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-util\") pod \"6ec844ee-2169-465a-9df7-c513e1c90a87\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " Jul 16 00:47:47.882335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.882287 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5kl4\" (UniqueName: \"kubernetes.io/projected/6ec844ee-2169-465a-9df7-c513e1c90a87-kube-api-access-h5kl4\") pod \"6ec844ee-2169-465a-9df7-c513e1c90a87\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " Jul 16 00:47:47.882335 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.882316 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-bundle\") pod \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " Jul 16 00:47:47.882594 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.882371 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lw4z\" (UniqueName: \"kubernetes.io/projected/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-kube-api-access-5lw4z\") pod \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " Jul 16 00:47:47.882594 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.882414 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-util\") pod \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\" (UID: \"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9\") " Jul 16 00:47:47.882594 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.882458 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-bundle\") pod \"6ec844ee-2169-465a-9df7-c513e1c90a87\" (UID: \"6ec844ee-2169-465a-9df7-c513e1c90a87\") " Jul 16 00:47:47.882940 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.882909 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-bundle" (OuterVolumeSpecName: "bundle") pod "c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" (UID: "c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:47.883137 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.883100 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-bundle" (OuterVolumeSpecName: "bundle") pod "6ec844ee-2169-465a-9df7-c513e1c90a87" (UID: "6ec844ee-2169-465a-9df7-c513e1c90a87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:47.884581 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.884553 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec844ee-2169-465a-9df7-c513e1c90a87-kube-api-access-h5kl4" (OuterVolumeSpecName: "kube-api-access-h5kl4") pod "6ec844ee-2169-465a-9df7-c513e1c90a87" (UID: "6ec844ee-2169-465a-9df7-c513e1c90a87"). InnerVolumeSpecName "kube-api-access-h5kl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:47:47.884958 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.884929 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-kube-api-access-5lw4z" (OuterVolumeSpecName: "kube-api-access-5lw4z") pod "c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" (UID: "c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9"). InnerVolumeSpecName "kube-api-access-5lw4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:47:47.888347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.888324 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-util" (OuterVolumeSpecName: "util") pod "6ec844ee-2169-465a-9df7-c513e1c90a87" (UID: "6ec844ee-2169-465a-9df7-c513e1c90a87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:47.888862 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.888842 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-util" (OuterVolumeSpecName: "util") pod "c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" (UID: "c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:47.983264 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.983230 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-util\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:47.983264 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.983262 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5kl4\" (UniqueName: \"kubernetes.io/projected/6ec844ee-2169-465a-9df7-c513e1c90a87-kube-api-access-h5kl4\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:47.983461 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.983274 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:47.983461 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.983283 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lw4z\" (UniqueName: \"kubernetes.io/projected/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-kube-api-access-5lw4z\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:47.983461 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.983291 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9-util\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:47.983461 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:47.983299 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ec844ee-2169-465a-9df7-c513e1c90a87-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:48.636916 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.636883 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" Jul 16 00:47:48.636916 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.636901 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb" event={"ID":"c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9","Type":"ContainerDied","Data":"10e455265f8022e8af56688ab7bd214904131c17462ea2f108189927e0d5959a"} Jul 16 00:47:48.637439 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.636952 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10e455265f8022e8af56688ab7bd214904131c17462ea2f108189927e0d5959a" Jul 16 00:47:48.638925 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.638909 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" Jul 16 00:47:48.639023 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.638942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw" event={"ID":"6ec844ee-2169-465a-9df7-c513e1c90a87","Type":"ContainerDied","Data":"ea837103d1407e2d58184fa2fa8a1954a51e054daad75e49e052032a0f31043d"} Jul 16 00:47:48.639023 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.638987 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea837103d1407e2d58184fa2fa8a1954a51e054daad75e49e052032a0f31043d" Jul 16 00:47:48.641086 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.641060 2572 generic.go:356] "Generic (PLEG): container finished" podID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerID="d693265718f041ddf34dec070132fbef37807593e8565ec266e0cbba201cebf5" exitCode=0 Jul 16 00:47:48.641237 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.641137 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" event={"ID":"4f7e4188-1da6-41a0-8cb3-03fb573facf0","Type":"ContainerDied","Data":"d693265718f041ddf34dec070132fbef37807593e8565ec266e0cbba201cebf5"} Jul 16 00:47:48.771520 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.771497 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:48.789079 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.789032 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-bundle\") pod \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " Jul 16 00:47:48.789247 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.789087 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7pg7\" (UniqueName: \"kubernetes.io/projected/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-kube-api-access-w7pg7\") pod \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " Jul 16 00:47:48.789247 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.789131 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-util\") pod \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\" (UID: \"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd\") " Jul 16 00:47:48.790933 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.790902 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-bundle" (OuterVolumeSpecName: "bundle") pod "b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" (UID: "b4ada6c2-90b9-414d-9eb5-d6c87fa482dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:48.792135 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.792106 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-kube-api-access-w7pg7" (OuterVolumeSpecName: "kube-api-access-w7pg7") pod "b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" (UID: "b4ada6c2-90b9-414d-9eb5-d6c87fa482dd"). InnerVolumeSpecName "kube-api-access-w7pg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:47:48.796922 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.796889 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-util" (OuterVolumeSpecName: "util") pod "b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" (UID: "b4ada6c2-90b9-414d-9eb5-d6c87fa482dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:48.890004 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.889919 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:48.890004 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.889945 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7pg7\" (UniqueName: \"kubernetes.io/projected/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-kube-api-access-w7pg7\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:48.890004 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:48.889955 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ada6c2-90b9-414d-9eb5-d6c87fa482dd-util\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:49.648139 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.648108 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" Jul 16 00:47:49.648533 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.648136 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl" event={"ID":"b4ada6c2-90b9-414d-9eb5-d6c87fa482dd","Type":"ContainerDied","Data":"0a7e27410a8b84ae47f0e9464eac34e40fb49a5ad109af5e27f40755062c99af"} Jul 16 00:47:49.648533 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.648196 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a7e27410a8b84ae47f0e9464eac34e40fb49a5ad109af5e27f40755062c99af" Jul 16 00:47:49.778859 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.778832 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:49.795613 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.795592 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-util\") pod \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " Jul 16 00:47:49.795733 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.795667 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf5gs\" (UniqueName: \"kubernetes.io/projected/4f7e4188-1da6-41a0-8cb3-03fb573facf0-kube-api-access-zf5gs\") pod \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " Jul 16 00:47:49.795733 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.795686 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-bundle\") pod \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\" (UID: \"4f7e4188-1da6-41a0-8cb3-03fb573facf0\") " Jul 16 00:47:49.796259 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.796235 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-bundle" (OuterVolumeSpecName: "bundle") pod "4f7e4188-1da6-41a0-8cb3-03fb573facf0" (UID: "4f7e4188-1da6-41a0-8cb3-03fb573facf0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:49.798226 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.798155 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7e4188-1da6-41a0-8cb3-03fb573facf0-kube-api-access-zf5gs" (OuterVolumeSpecName: "kube-api-access-zf5gs") pod "4f7e4188-1da6-41a0-8cb3-03fb573facf0" (UID: "4f7e4188-1da6-41a0-8cb3-03fb573facf0"). InnerVolumeSpecName "kube-api-access-zf5gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:47:49.803148 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.803117 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-util" (OuterVolumeSpecName: "util") pod "4f7e4188-1da6-41a0-8cb3-03fb573facf0" (UID: "4f7e4188-1da6-41a0-8cb3-03fb573facf0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:47:49.897122 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.897041 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf5gs\" (UniqueName: \"kubernetes.io/projected/4f7e4188-1da6-41a0-8cb3-03fb573facf0-kube-api-access-zf5gs\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:49.897122 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.897070 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:49.897122 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:49.897081 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f7e4188-1da6-41a0-8cb3-03fb573facf0-util\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:47:50.654976 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:50.654941 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" event={"ID":"4f7e4188-1da6-41a0-8cb3-03fb573facf0","Type":"ContainerDied","Data":"27faa727bba89c9977cdce224f141f61fe6479e53f793f2b0188479776d3165f"} Jul 16 00:47:50.655373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:50.654989 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27faa727bba89c9977cdce224f141f61fe6479e53f793f2b0188479776d3165f" Jul 16 00:47:50.655373 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:50.654956 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t" Jul 16 00:47:57.196280 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196245 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64b876658d-hhslc"] Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196539 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerName="pull" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196549 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerName="pull" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196560 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerName="pull" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196566 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerName="pull" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196578 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196583 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196590 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196595 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196606 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerName="util" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196611 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerName="util" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196616 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196621 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196626 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerName="pull" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196631 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerName="pull" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196639 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196644 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerName="extract" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196651 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerName="util" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196656 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerName="util" Jul 16 00:47:57.196651 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196661 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerName="util" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196666 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerName="util" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196671 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerName="util" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196675 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerName="util" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196679 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerName="pull" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196684 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerName="pull" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196726 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9" containerName="extract" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196735 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ada6c2-90b9-414d-9eb5-d6c87fa482dd" containerName="extract" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196742 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec844ee-2169-465a-9df7-c513e1c90a87" containerName="extract" Jul 16 00:47:57.197269 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.196748 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f7e4188-1da6-41a0-8cb3-03fb573facf0" containerName="extract" Jul 16 00:47:57.199969 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.199945 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.219443 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.219414 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b876658d-hhslc"] Jul 16 00:47:57.253899 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.253853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4mwn\" (UniqueName: \"kubernetes.io/projected/bae573ad-aea2-4138-8eac-1765ff66071e-kube-api-access-r4mwn\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.253899 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.253901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-oauth-serving-cert\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.254142 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.253922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae573ad-aea2-4138-8eac-1765ff66071e-console-oauth-config\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.254142 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.253996 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-trusted-ca-bundle\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.254142 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.254021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-service-ca\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.254142 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.254054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-console-config\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.254142 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.254124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae573ad-aea2-4138-8eac-1765ff66071e-console-serving-cert\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355096 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae573ad-aea2-4138-8eac-1765ff66071e-console-oauth-config\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355289 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-trusted-ca-bundle\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355289 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355148 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-service-ca\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355289 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-console-config\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355289 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae573ad-aea2-4138-8eac-1765ff66071e-console-serving-cert\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355534 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mwn\" (UniqueName: \"kubernetes.io/projected/bae573ad-aea2-4138-8eac-1765ff66071e-kube-api-access-r4mwn\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355534 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355334 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-oauth-serving-cert\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.355947 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.355927 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-console-config\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.356062 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.356020 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-service-ca\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.356125 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.356110 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-oauth-serving-cert\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.356206 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.356141 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae573ad-aea2-4138-8eac-1765ff66071e-trusted-ca-bundle\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.358173 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.358144 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae573ad-aea2-4138-8eac-1765ff66071e-console-oauth-config\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.358173 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.358147 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae573ad-aea2-4138-8eac-1765ff66071e-console-serving-cert\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.370696 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.370668 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4mwn\" (UniqueName: \"kubernetes.io/projected/bae573ad-aea2-4138-8eac-1765ff66071e-kube-api-access-r4mwn\") pod \"console-64b876658d-hhslc\" (UID: \"bae573ad-aea2-4138-8eac-1765ff66071e\") " pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.508908 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.508812 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:47:57.644487 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.644459 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b876658d-hhslc"] Jul 16 00:47:57.645704 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:47:57.645677 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae573ad_aea2_4138_8eac_1765ff66071e.slice/crio-89bea5e4c2ad7bf08750ebe9c2c582bb1dbfdfbf6511970130d23ab6dd978b0d WatchSource:0}: Error finding container 89bea5e4c2ad7bf08750ebe9c2c582bb1dbfdfbf6511970130d23ab6dd978b0d: Status 404 returned error can't find the container with id 89bea5e4c2ad7bf08750ebe9c2c582bb1dbfdfbf6511970130d23ab6dd978b0d Jul 16 00:47:57.689713 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:57.689689 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b876658d-hhslc" event={"ID":"bae573ad-aea2-4138-8eac-1765ff66071e","Type":"ContainerStarted","Data":"89bea5e4c2ad7bf08750ebe9c2c582bb1dbfdfbf6511970130d23ab6dd978b0d"} Jul 16 00:47:58.697432 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:58.697391 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b876658d-hhslc" event={"ID":"bae573ad-aea2-4138-8eac-1765ff66071e","Type":"ContainerStarted","Data":"3d3e9f32e06612823b55c02cab56438e5a46c0b33a57f2862af36fb6afdf625d"} Jul 16 00:47:58.721636 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:47:58.721583 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64b876658d-hhslc" podStartSLOduration=1.721563831 podStartE2EDuration="1.721563831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:47:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:47:58.719798916 +0000 UTC m=+457.641847732" watchObservedRunningTime="2026-07-16 00:47:58.721563831 +0000 UTC m=+457.643612646" Jul 16 00:48:07.509161 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:07.509114 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:48:07.509542 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:07.509206 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:48:07.514231 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:07.514195 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:48:07.748611 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:07.748583 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64b876658d-hhslc" Jul 16 00:48:07.831454 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:07.831369 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9fff9759-zwdhw"] Jul 16 00:48:27.623907 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.623872 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv"] Jul 16 00:48:27.629259 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.629236 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" Jul 16 00:48:27.632466 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.632440 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 00:48:27.632466 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.632455 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 00:48:27.633089 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.633073 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vrjvw\"" Jul 16 00:48:27.646129 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.646103 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv"] Jul 16 00:48:27.725569 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.725528 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54src\" (UniqueName: \"kubernetes.io/projected/929f9487-93ca-4812-986f-dcfc47a94801-kube-api-access-54src\") pod \"limitador-operator-controller-manager-859d7b78bd-cbvcv\" (UID: \"929f9487-93ca-4812-986f-dcfc47a94801\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" Jul 16 00:48:27.825960 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.825919 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54src\" (UniqueName: \"kubernetes.io/projected/929f9487-93ca-4812-986f-dcfc47a94801-kube-api-access-54src\") pod \"limitador-operator-controller-manager-859d7b78bd-cbvcv\" (UID: \"929f9487-93ca-4812-986f-dcfc47a94801\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" Jul 16 00:48:27.839296 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.839265 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54src\" (UniqueName: \"kubernetes.io/projected/929f9487-93ca-4812-986f-dcfc47a94801-kube-api-access-54src\") pod \"limitador-operator-controller-manager-859d7b78bd-cbvcv\" (UID: \"929f9487-93ca-4812-986f-dcfc47a94801\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" Jul 16 00:48:27.941389 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:27.941299 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" Jul 16 00:48:28.116039 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:28.116014 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv"] Jul 16 00:48:28.117963 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:48:28.117933 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929f9487_93ca_4812_986f_dcfc47a94801.slice/crio-71ec56ff3350ef319c61c825778af3622d64bd647f63e67f98cd66f9c661c6a3 WatchSource:0}: Error finding container 71ec56ff3350ef319c61c825778af3622d64bd647f63e67f98cd66f9c661c6a3: Status 404 returned error can't find the container with id 71ec56ff3350ef319c61c825778af3622d64bd647f63e67f98cd66f9c661c6a3 Jul 16 00:48:28.849596 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:28.849564 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" event={"ID":"929f9487-93ca-4812-986f-dcfc47a94801","Type":"ContainerStarted","Data":"71ec56ff3350ef319c61c825778af3622d64bd647f63e67f98cd66f9c661c6a3"} Jul 16 00:48:30.863629 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:30.863596 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" event={"ID":"929f9487-93ca-4812-986f-dcfc47a94801","Type":"ContainerStarted","Data":"e337c1e232dc385f42ac96c492ac78466f9de4da6fe3c8a6098bf674bf351db4"} Jul 16 00:48:30.864013 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:30.863697 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" Jul 16 00:48:30.886096 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:30.886042 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" podStartSLOduration=1.963373186 podStartE2EDuration="3.886023163s" totalImagesPullingTime="1.922649977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:30.885855735 +0000 UTC m=+489.807904545" watchObservedRunningTime="2026-07-16 00:48:30.886023163 +0000 UTC m=+489.808071978" Jul 16 00:48:32.852003 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:32.851930 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f9fff9759-zwdhw" podUID="abf28a15-b07c-4444-8dae-22a67369c96d" containerName="console" containerID="cri-o://e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c" gracePeriod=15 Jul 16 00:48:33.111232 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.111157 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:48:33.172156 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172127 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-console-config\") pod \"abf28a15-b07c-4444-8dae-22a67369c96d\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " Jul 16 00:48:33.172336 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172164 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-trusted-ca-bundle\") pod \"abf28a15-b07c-4444-8dae-22a67369c96d\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " Jul 16 00:48:33.172336 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172210 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-service-ca\") pod \"abf28a15-b07c-4444-8dae-22a67369c96d\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " Jul 16 00:48:33.172336 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172230 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-oauth-serving-cert\") pod \"abf28a15-b07c-4444-8dae-22a67369c96d\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " Jul 16 00:48:33.172336 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172254 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-oauth-config\") pod \"abf28a15-b07c-4444-8dae-22a67369c96d\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " Jul 16 00:48:33.172549 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172370 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7nvq\" (UniqueName: \"kubernetes.io/projected/abf28a15-b07c-4444-8dae-22a67369c96d-kube-api-access-h7nvq\") pod \"abf28a15-b07c-4444-8dae-22a67369c96d\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " Jul 16 00:48:33.172549 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172414 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-serving-cert\") pod \"abf28a15-b07c-4444-8dae-22a67369c96d\" (UID: \"abf28a15-b07c-4444-8dae-22a67369c96d\") " Jul 16 00:48:33.172913 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172882 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-console-config" (OuterVolumeSpecName: "console-config") pod "abf28a15-b07c-4444-8dae-22a67369c96d" (UID: "abf28a15-b07c-4444-8dae-22a67369c96d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:48:33.172913 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172889 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "abf28a15-b07c-4444-8dae-22a67369c96d" (UID: "abf28a15-b07c-4444-8dae-22a67369c96d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:48:33.172913 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172906 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-service-ca" (OuterVolumeSpecName: "service-ca") pod "abf28a15-b07c-4444-8dae-22a67369c96d" (UID: "abf28a15-b07c-4444-8dae-22a67369c96d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:48:33.173129 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.172966 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "abf28a15-b07c-4444-8dae-22a67369c96d" (UID: "abf28a15-b07c-4444-8dae-22a67369c96d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:48:33.174427 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.174399 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "abf28a15-b07c-4444-8dae-22a67369c96d" (UID: "abf28a15-b07c-4444-8dae-22a67369c96d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:48:33.174569 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.174547 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf28a15-b07c-4444-8dae-22a67369c96d-kube-api-access-h7nvq" (OuterVolumeSpecName: "kube-api-access-h7nvq") pod "abf28a15-b07c-4444-8dae-22a67369c96d" (UID: "abf28a15-b07c-4444-8dae-22a67369c96d"). InnerVolumeSpecName "kube-api-access-h7nvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:48:33.174613 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.174544 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "abf28a15-b07c-4444-8dae-22a67369c96d" (UID: "abf28a15-b07c-4444-8dae-22a67369c96d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:48:33.273685 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.273652 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7nvq\" (UniqueName: \"kubernetes.io/projected/abf28a15-b07c-4444-8dae-22a67369c96d-kube-api-access-h7nvq\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:48:33.273685 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.273677 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:48:33.273685 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.273686 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-console-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:48:33.273685 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.273694 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-trusted-ca-bundle\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:48:33.273926 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.273703 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-service-ca\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:48:33.273926 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.273711 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abf28a15-b07c-4444-8dae-22a67369c96d-oauth-serving-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:48:33.273926 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.273719 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abf28a15-b07c-4444-8dae-22a67369c96d-console-oauth-config\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:48:33.879465 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.879380 2572 generic.go:356] "Generic (PLEG): container finished" podID="abf28a15-b07c-4444-8dae-22a67369c96d" containerID="e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c" exitCode=0 Jul 16 00:48:33.879465 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.879425 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9fff9759-zwdhw" Jul 16 00:48:33.879465 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.879455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9fff9759-zwdhw" event={"ID":"abf28a15-b07c-4444-8dae-22a67369c96d","Type":"ContainerDied","Data":"e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c"} Jul 16 00:48:33.879948 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.879504 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9fff9759-zwdhw" event={"ID":"abf28a15-b07c-4444-8dae-22a67369c96d","Type":"ContainerDied","Data":"2e158c94e9744bc8df5c08a2503034952db3362dcc4f44d54ba9712e9b9dbbaf"} Jul 16 00:48:33.879948 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.879525 2572 scope.go:117] "RemoveContainer" containerID="e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c" Jul 16 00:48:33.887965 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.887948 2572 scope.go:117] "RemoveContainer" containerID="e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c" Jul 16 00:48:33.888241 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:48:33.888219 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c\": container with ID starting with e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c not found: ID does not exist" containerID="e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c" Jul 16 00:48:33.888330 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.888247 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c"} err="failed to get container status \"e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c\": rpc error: code = NotFound desc = could not find container \"e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c\": container with ID starting with e55745de1a8ed29bc5af2563c704d5d60c4c458a93533e9e2abd02bc0e18715c not found: ID does not exist" Jul 16 00:48:33.895400 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.895377 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9fff9759-zwdhw"] Jul 16 00:48:33.899898 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:33.899874 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9fff9759-zwdhw"] Jul 16 00:48:35.601915 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:35.601883 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf28a15-b07c-4444-8dae-22a67369c96d" path="/var/lib/kubelet/pods/abf28a15-b07c-4444-8dae-22a67369c96d/volumes" Jul 16 00:48:41.871375 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:48:41.871343 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbvcv" Jul 16 00:49:00.208554 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.208513 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwmbs"] Jul 16 00:49:00.209146 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.208969 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf28a15-b07c-4444-8dae-22a67369c96d" containerName="console" Jul 16 00:49:00.209146 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.208988 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf28a15-b07c-4444-8dae-22a67369c96d" containerName="console" Jul 16 00:49:00.209146 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.209061 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="abf28a15-b07c-4444-8dae-22a67369c96d" containerName="console" Jul 16 00:49:00.215063 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.215040 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwmbs" Jul 16 00:49:00.217790 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.217744 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7cmff\"" Jul 16 00:49:00.223587 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.223564 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwmbs"] Jul 16 00:49:00.303618 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.303582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbx6z\" (UniqueName: \"kubernetes.io/projected/4189d936-42b8-4570-8bd6-255f14409bb1-kube-api-access-fbx6z\") pod \"authorino-75d556bd77-cwmbs\" (UID: \"4189d936-42b8-4570-8bd6-255f14409bb1\") " pod="kuadrant-system/authorino-75d556bd77-cwmbs" Jul 16 00:49:00.404884 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.404844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbx6z\" (UniqueName: \"kubernetes.io/projected/4189d936-42b8-4570-8bd6-255f14409bb1-kube-api-access-fbx6z\") pod \"authorino-75d556bd77-cwmbs\" (UID: \"4189d936-42b8-4570-8bd6-255f14409bb1\") " pod="kuadrant-system/authorino-75d556bd77-cwmbs" Jul 16 00:49:00.421973 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.421949 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbx6z\" (UniqueName: \"kubernetes.io/projected/4189d936-42b8-4570-8bd6-255f14409bb1-kube-api-access-fbx6z\") pod \"authorino-75d556bd77-cwmbs\" (UID: \"4189d936-42b8-4570-8bd6-255f14409bb1\") " pod="kuadrant-system/authorino-75d556bd77-cwmbs" Jul 16 00:49:00.524889 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.524792 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwmbs" Jul 16 00:49:00.658134 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:00.658103 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwmbs"] Jul 16 00:49:00.660618 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:49:00.660591 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4189d936_42b8_4570_8bd6_255f14409bb1.slice/crio-4f368d1e7d1c102ec5bacf35a508410d1fcad1c0bcb963e9449b5f7b63727380 WatchSource:0}: Error finding container 4f368d1e7d1c102ec5bacf35a508410d1fcad1c0bcb963e9449b5f7b63727380: Status 404 returned error can't find the container with id 4f368d1e7d1c102ec5bacf35a508410d1fcad1c0bcb963e9449b5f7b63727380 Jul 16 00:49:01.010255 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:01.010216 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwmbs" event={"ID":"4189d936-42b8-4570-8bd6-255f14409bb1","Type":"ContainerStarted","Data":"4f368d1e7d1c102ec5bacf35a508410d1fcad1c0bcb963e9449b5f7b63727380"} Jul 16 00:49:04.029911 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:04.029864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwmbs" event={"ID":"4189d936-42b8-4570-8bd6-255f14409bb1","Type":"ContainerStarted","Data":"f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351"} Jul 16 00:49:04.045611 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:04.045489 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cwmbs" podStartSLOduration=0.922162914 podStartE2EDuration="4.045470726s" totalImagesPullingTime="3.123307812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:04.044123013 +0000 UTC m=+522.966171855" watchObservedRunningTime="2026-07-16 00:49:04.045470726 +0000 UTC m=+522.967519541" Jul 16 00:49:33.825916 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:33.825878 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bcw9x"] Jul 16 00:49:33.830613 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:33.830592 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" Jul 16 00:49:33.835683 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:33.835655 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bcw9x"] Jul 16 00:49:33.992262 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:33.992224 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4xs\" (UniqueName: \"kubernetes.io/projected/c266bfdb-8b1b-40ba-a563-70464769cf5f-kube-api-access-fb4xs\") pod \"authorino-5d4b67c446-bcw9x\" (UID: \"c266bfdb-8b1b-40ba-a563-70464769cf5f\") " pod="kuadrant-system/authorino-5d4b67c446-bcw9x" Jul 16 00:49:34.093605 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.093517 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4xs\" (UniqueName: \"kubernetes.io/projected/c266bfdb-8b1b-40ba-a563-70464769cf5f-kube-api-access-fb4xs\") pod \"authorino-5d4b67c446-bcw9x\" (UID: \"c266bfdb-8b1b-40ba-a563-70464769cf5f\") " pod="kuadrant-system/authorino-5d4b67c446-bcw9x" Jul 16 00:49:34.109078 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.109056 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4xs\" (UniqueName: \"kubernetes.io/projected/c266bfdb-8b1b-40ba-a563-70464769cf5f-kube-api-access-fb4xs\") pod \"authorino-5d4b67c446-bcw9x\" (UID: \"c266bfdb-8b1b-40ba-a563-70464769cf5f\") " pod="kuadrant-system/authorino-5d4b67c446-bcw9x" Jul 16 00:49:34.121287 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.121259 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bcw9x"] Jul 16 00:49:34.121483 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.121470 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" Jul 16 00:49:34.165616 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.165585 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68b55bb8c-bzdpd"] Jul 16 00:49:34.168945 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.168926 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" Jul 16 00:49:34.176927 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.176904 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68b55bb8c-bzdpd"] Jul 16 00:49:34.257816 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.257786 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bcw9x"] Jul 16 00:49:34.259809 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:49:34.259777 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc266bfdb_8b1b_40ba_a563_70464769cf5f.slice/crio-793af47c1262a70b1992ff457afd63596cc649de73faa138fee7f5e7b22c31f5 WatchSource:0}: Error finding container 793af47c1262a70b1992ff457afd63596cc649de73faa138fee7f5e7b22c31f5: Status 404 returned error can't find the container with id 793af47c1262a70b1992ff457afd63596cc649de73faa138fee7f5e7b22c31f5 Jul 16 00:49:34.295501 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.295474 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjxmf\" (UniqueName: \"kubernetes.io/projected/e997fab5-7f52-4e1d-8e60-4439cbea5d31-kube-api-access-qjxmf\") pod \"authorino-68b55bb8c-bzdpd\" (UID: \"e997fab5-7f52-4e1d-8e60-4439cbea5d31\") " pod="kuadrant-system/authorino-68b55bb8c-bzdpd" Jul 16 00:49:34.396620 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.396582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjxmf\" (UniqueName: \"kubernetes.io/projected/e997fab5-7f52-4e1d-8e60-4439cbea5d31-kube-api-access-qjxmf\") pod \"authorino-68b55bb8c-bzdpd\" (UID: \"e997fab5-7f52-4e1d-8e60-4439cbea5d31\") " pod="kuadrant-system/authorino-68b55bb8c-bzdpd" Jul 16 00:49:34.404768 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.404739 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjxmf\" (UniqueName: \"kubernetes.io/projected/e997fab5-7f52-4e1d-8e60-4439cbea5d31-kube-api-access-qjxmf\") pod \"authorino-68b55bb8c-bzdpd\" (UID: \"e997fab5-7f52-4e1d-8e60-4439cbea5d31\") " pod="kuadrant-system/authorino-68b55bb8c-bzdpd" Jul 16 00:49:34.420082 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.420052 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b55bb8c-bzdpd"] Jul 16 00:49:34.420287 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.420274 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" Jul 16 00:49:34.450169 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.450132 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6674bf9cd7-ntqgp"] Jul 16 00:49:34.453616 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.453589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.455713 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.455687 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 16 00:49:34.462165 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.462003 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6674bf9cd7-ntqgp"] Jul 16 00:49:34.571305 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.571283 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b55bb8c-bzdpd"] Jul 16 00:49:34.572861 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:49:34.572839 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode997fab5_7f52_4e1d_8e60_4439cbea5d31.slice/crio-3b0f86cba1e902044739c9b897e06f37322587b2e3525428bb8432f1fd255c5c WatchSource:0}: Error finding container 3b0f86cba1e902044739c9b897e06f37322587b2e3525428bb8432f1fd255c5c: Status 404 returned error can't find the container with id 3b0f86cba1e902044739c9b897e06f37322587b2e3525428bb8432f1fd255c5c Jul 16 00:49:34.598266 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.598243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd092050-fc76-42b6-b170-1f81d683bf31-tls-cert\") pod \"authorino-6674bf9cd7-ntqgp\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.598347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.598277 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457nq\" (UniqueName: \"kubernetes.io/projected/dd092050-fc76-42b6-b170-1f81d683bf31-kube-api-access-457nq\") pod \"authorino-6674bf9cd7-ntqgp\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.698756 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.698666 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd092050-fc76-42b6-b170-1f81d683bf31-tls-cert\") pod \"authorino-6674bf9cd7-ntqgp\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.698756 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.698721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457nq\" (UniqueName: \"kubernetes.io/projected/dd092050-fc76-42b6-b170-1f81d683bf31-kube-api-access-457nq\") pod \"authorino-6674bf9cd7-ntqgp\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.701168 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.701144 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd092050-fc76-42b6-b170-1f81d683bf31-tls-cert\") pod \"authorino-6674bf9cd7-ntqgp\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.708346 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.708317 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-457nq\" (UniqueName: \"kubernetes.io/projected/dd092050-fc76-42b6-b170-1f81d683bf31-kube-api-access-457nq\") pod \"authorino-6674bf9cd7-ntqgp\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.765653 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.765616 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:49:34.897303 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:34.897279 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6674bf9cd7-ntqgp"] Jul 16 00:49:34.898884 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:49:34.898860 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd092050_fc76_42b6_b170_1f81d683bf31.slice/crio-0ac6370b1df263eb3ba738a0c6f54f9627cf5c8ff84d0338f0e1011ea3dafa3d WatchSource:0}: Error finding container 0ac6370b1df263eb3ba738a0c6f54f9627cf5c8ff84d0338f0e1011ea3dafa3d: Status 404 returned error can't find the container with id 0ac6370b1df263eb3ba738a0c6f54f9627cf5c8ff84d0338f0e1011ea3dafa3d Jul 16 00:49:35.191574 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.191534 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" event={"ID":"c266bfdb-8b1b-40ba-a563-70464769cf5f","Type":"ContainerStarted","Data":"43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482"} Jul 16 00:49:35.191777 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.191582 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" event={"ID":"c266bfdb-8b1b-40ba-a563-70464769cf5f","Type":"ContainerStarted","Data":"793af47c1262a70b1992ff457afd63596cc649de73faa138fee7f5e7b22c31f5"} Jul 16 00:49:35.191777 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.191573 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" podUID="c266bfdb-8b1b-40ba-a563-70464769cf5f" containerName="authorino" containerID="cri-o://43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482" gracePeriod=30 Jul 16 00:49:35.193329 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.193305 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" event={"ID":"e997fab5-7f52-4e1d-8e60-4439cbea5d31","Type":"ContainerStarted","Data":"c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97"} Jul 16 00:49:35.193431 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.193339 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" event={"ID":"e997fab5-7f52-4e1d-8e60-4439cbea5d31","Type":"ContainerStarted","Data":"3b0f86cba1e902044739c9b897e06f37322587b2e3525428bb8432f1fd255c5c"} Jul 16 00:49:35.193431 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.193390 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" podUID="e997fab5-7f52-4e1d-8e60-4439cbea5d31" containerName="authorino" containerID="cri-o://c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97" gracePeriod=30 Jul 16 00:49:35.194637 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.194610 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" event={"ID":"dd092050-fc76-42b6-b170-1f81d683bf31","Type":"ContainerStarted","Data":"0ac6370b1df263eb3ba738a0c6f54f9627cf5c8ff84d0338f0e1011ea3dafa3d"} Jul 16 00:49:35.208417 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.208370 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" podStartSLOduration=1.8736519870000001 podStartE2EDuration="2.208354333s" totalImagesPullingTime="334.702346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:35.205830105 +0000 UTC m=+554.127878945" watchObservedRunningTime="2026-07-16 00:49:35.208354333 +0000 UTC m=+554.130403151" Jul 16 00:49:35.222338 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.222294 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" podStartSLOduration=0.844977619 podStartE2EDuration="1.22227975s" totalImagesPullingTime="377.302131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:35.220588583 +0000 UTC m=+554.142637418" watchObservedRunningTime="2026-07-16 00:49:35.22227975 +0000 UTC m=+554.144328565" Jul 16 00:49:35.464650 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.464627 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" Jul 16 00:49:35.468372 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.468349 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" Jul 16 00:49:35.605770 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.605742 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb4xs\" (UniqueName: \"kubernetes.io/projected/c266bfdb-8b1b-40ba-a563-70464769cf5f-kube-api-access-fb4xs\") pod \"c266bfdb-8b1b-40ba-a563-70464769cf5f\" (UID: \"c266bfdb-8b1b-40ba-a563-70464769cf5f\") " Jul 16 00:49:35.605912 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.605780 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjxmf\" (UniqueName: \"kubernetes.io/projected/e997fab5-7f52-4e1d-8e60-4439cbea5d31-kube-api-access-qjxmf\") pod \"e997fab5-7f52-4e1d-8e60-4439cbea5d31\" (UID: \"e997fab5-7f52-4e1d-8e60-4439cbea5d31\") " Jul 16 00:49:35.607807 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.607781 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e997fab5-7f52-4e1d-8e60-4439cbea5d31-kube-api-access-qjxmf" (OuterVolumeSpecName: "kube-api-access-qjxmf") pod "e997fab5-7f52-4e1d-8e60-4439cbea5d31" (UID: "e997fab5-7f52-4e1d-8e60-4439cbea5d31"). InnerVolumeSpecName "kube-api-access-qjxmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:35.607886 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.607830 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c266bfdb-8b1b-40ba-a563-70464769cf5f-kube-api-access-fb4xs" (OuterVolumeSpecName: "kube-api-access-fb4xs") pod "c266bfdb-8b1b-40ba-a563-70464769cf5f" (UID: "c266bfdb-8b1b-40ba-a563-70464769cf5f"). InnerVolumeSpecName "kube-api-access-fb4xs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:35.706586 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.706548 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb4xs\" (UniqueName: \"kubernetes.io/projected/c266bfdb-8b1b-40ba-a563-70464769cf5f-kube-api-access-fb4xs\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:49:35.706586 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:35.706586 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjxmf\" (UniqueName: \"kubernetes.io/projected/e997fab5-7f52-4e1d-8e60-4439cbea5d31-kube-api-access-qjxmf\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:49:36.201046 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.201004 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" event={"ID":"dd092050-fc76-42b6-b170-1f81d683bf31","Type":"ContainerStarted","Data":"c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b"} Jul 16 00:49:36.202256 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.202228 2572 generic.go:356] "Generic (PLEG): container finished" podID="c266bfdb-8b1b-40ba-a563-70464769cf5f" containerID="43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482" exitCode=0 Jul 16 00:49:36.202347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.202275 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" Jul 16 00:49:36.202347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.202317 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" event={"ID":"c266bfdb-8b1b-40ba-a563-70464769cf5f","Type":"ContainerDied","Data":"43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482"} Jul 16 00:49:36.202450 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.202360 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bcw9x" event={"ID":"c266bfdb-8b1b-40ba-a563-70464769cf5f","Type":"ContainerDied","Data":"793af47c1262a70b1992ff457afd63596cc649de73faa138fee7f5e7b22c31f5"} Jul 16 00:49:36.202450 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.202378 2572 scope.go:117] "RemoveContainer" containerID="43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482" Jul 16 00:49:36.203624 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.203604 2572 generic.go:356] "Generic (PLEG): container finished" podID="e997fab5-7f52-4e1d-8e60-4439cbea5d31" containerID="c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97" exitCode=0 Jul 16 00:49:36.203716 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.203660 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" Jul 16 00:49:36.203787 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.203662 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" event={"ID":"e997fab5-7f52-4e1d-8e60-4439cbea5d31","Type":"ContainerDied","Data":"c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97"} Jul 16 00:49:36.203851 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.203836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b55bb8c-bzdpd" event={"ID":"e997fab5-7f52-4e1d-8e60-4439cbea5d31","Type":"ContainerDied","Data":"3b0f86cba1e902044739c9b897e06f37322587b2e3525428bb8432f1fd255c5c"} Jul 16 00:49:36.211781 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.211766 2572 scope.go:117] "RemoveContainer" containerID="43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482" Jul 16 00:49:36.212068 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:49:36.212048 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482\": container with ID starting with 43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482 not found: ID does not exist" containerID="43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482" Jul 16 00:49:36.212155 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.212078 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482"} err="failed to get container status \"43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482\": rpc error: code = NotFound desc = could not find container \"43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482\": container with ID starting with 43aba87eb5cf494a22558cb00ffc9b7e75d6518ff1bd16d14ec079056dc22482 not found: ID does not exist" Jul 16 00:49:36.212155 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.212100 2572 scope.go:117] "RemoveContainer" containerID="c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97" Jul 16 00:49:36.215991 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.215948 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" podStartSLOduration=1.803365404 podStartE2EDuration="2.215933576s" totalImagesPullingTime="412.568172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:36.214886694 +0000 UTC m=+555.136935542" watchObservedRunningTime="2026-07-16 00:49:36.215933576 +0000 UTC m=+555.137982422" Jul 16 00:49:36.220107 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.220083 2572 scope.go:117] "RemoveContainer" containerID="c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97" Jul 16 00:49:36.220397 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:49:36.220380 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97\": container with ID starting with c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97 not found: ID does not exist" containerID="c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97" Jul 16 00:49:36.220454 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.220403 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97"} err="failed to get container status \"c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97\": rpc error: code = NotFound desc = could not find container \"c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97\": container with ID starting with c23bf320f3970bf4541fcda27228a0539e8216bbcbb4e81ae3b5c1d53fe14e97 not found: ID does not exist" Jul 16 00:49:36.230530 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.230495 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bcw9x"] Jul 16 00:49:36.236190 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.236143 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bcw9x"] Jul 16 00:49:36.243944 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.243911 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwmbs"] Jul 16 00:49:36.244267 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.244235 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cwmbs" podUID="4189d936-42b8-4570-8bd6-255f14409bb1" containerName="authorino" containerID="cri-o://f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351" gracePeriod=30 Jul 16 00:49:36.246728 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.246703 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b55bb8c-bzdpd"] Jul 16 00:49:36.258013 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.257981 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68b55bb8c-bzdpd"] Jul 16 00:49:36.508881 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.508858 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwmbs" Jul 16 00:49:36.514162 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.514141 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbx6z\" (UniqueName: \"kubernetes.io/projected/4189d936-42b8-4570-8bd6-255f14409bb1-kube-api-access-fbx6z\") pod \"4189d936-42b8-4570-8bd6-255f14409bb1\" (UID: \"4189d936-42b8-4570-8bd6-255f14409bb1\") " Jul 16 00:49:36.516096 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.516072 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4189d936-42b8-4570-8bd6-255f14409bb1-kube-api-access-fbx6z" (OuterVolumeSpecName: "kube-api-access-fbx6z") pod "4189d936-42b8-4570-8bd6-255f14409bb1" (UID: "4189d936-42b8-4570-8bd6-255f14409bb1"). InnerVolumeSpecName "kube-api-access-fbx6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:36.615122 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:36.615080 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbx6z\" (UniqueName: \"kubernetes.io/projected/4189d936-42b8-4570-8bd6-255f14409bb1-kube-api-access-fbx6z\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:49:37.209572 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.209531 2572 generic.go:356] "Generic (PLEG): container finished" podID="4189d936-42b8-4570-8bd6-255f14409bb1" containerID="f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351" exitCode=0 Jul 16 00:49:37.209572 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.209578 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwmbs" Jul 16 00:49:37.210028 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.209604 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwmbs" event={"ID":"4189d936-42b8-4570-8bd6-255f14409bb1","Type":"ContainerDied","Data":"f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351"} Jul 16 00:49:37.210028 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.209649 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwmbs" event={"ID":"4189d936-42b8-4570-8bd6-255f14409bb1","Type":"ContainerDied","Data":"4f368d1e7d1c102ec5bacf35a508410d1fcad1c0bcb963e9449b5f7b63727380"} Jul 16 00:49:37.210028 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.209674 2572 scope.go:117] "RemoveContainer" containerID="f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351" Jul 16 00:49:37.218794 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.218778 2572 scope.go:117] "RemoveContainer" containerID="f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351" Jul 16 00:49:37.219048 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:49:37.219030 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351\": container with ID starting with f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351 not found: ID does not exist" containerID="f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351" Jul 16 00:49:37.219086 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.219058 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351"} err="failed to get container status \"f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351\": rpc error: code = NotFound desc = could not find container \"f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351\": container with ID starting with f0bc29a7d295178b8266d17220ca091b9b09b1485b040e8a300cf346352e6351 not found: ID does not exist" Jul 16 00:49:37.231794 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.231756 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwmbs"] Jul 16 00:49:37.236024 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.235993 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwmbs"] Jul 16 00:49:37.602363 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.602335 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4189d936-42b8-4570-8bd6-255f14409bb1" path="/var/lib/kubelet/pods/4189d936-42b8-4570-8bd6-255f14409bb1/volumes" Jul 16 00:49:37.602655 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.602642 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c266bfdb-8b1b-40ba-a563-70464769cf5f" path="/var/lib/kubelet/pods/c266bfdb-8b1b-40ba-a563-70464769cf5f/volumes" Jul 16 00:49:37.602913 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:49:37.602903 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e997fab5-7f52-4e1d-8e60-4439cbea5d31" path="/var/lib/kubelet/pods/e997fab5-7f52-4e1d-8e60-4439cbea5d31/volumes" Jul 16 00:50:15.204642 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.204608 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-26s5d"] Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.204937 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e997fab5-7f52-4e1d-8e60-4439cbea5d31" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.204952 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e997fab5-7f52-4e1d-8e60-4439cbea5d31" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.204968 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4189d936-42b8-4570-8bd6-255f14409bb1" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.204973 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4189d936-42b8-4570-8bd6-255f14409bb1" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.204981 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c266bfdb-8b1b-40ba-a563-70464769cf5f" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.204986 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c266bfdb-8b1b-40ba-a563-70464769cf5f" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.205035 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e997fab5-7f52-4e1d-8e60-4439cbea5d31" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.205044 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c266bfdb-8b1b-40ba-a563-70464769cf5f" containerName="authorino" Jul 16 00:50:15.205145 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.205052 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4189d936-42b8-4570-8bd6-255f14409bb1" containerName="authorino" Jul 16 00:50:15.209330 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.209286 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.214331 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.214301 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kvcs9\"" Jul 16 00:50:15.214331 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.214319 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 00:50:15.228033 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.227966 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-26s5d"] Jul 16 00:50:15.346591 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.346537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f8wq\" (UniqueName: \"kubernetes.io/projected/151eeef3-6fce-4a97-b414-278fffdece35-kube-api-access-5f8wq\") pod \"payload-pre-processing-74584bb9f8-26s5d\" (UID: \"151eeef3-6fce-4a97-b414-278fffdece35\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.346782 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.346666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151eeef3-6fce-4a97-b414-278fffdece35-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-26s5d\" (UID: \"151eeef3-6fce-4a97-b414-278fffdece35\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.447767 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.447727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151eeef3-6fce-4a97-b414-278fffdece35-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-26s5d\" (UID: \"151eeef3-6fce-4a97-b414-278fffdece35\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.447954 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.447807 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f8wq\" (UniqueName: \"kubernetes.io/projected/151eeef3-6fce-4a97-b414-278fffdece35-kube-api-access-5f8wq\") pod \"payload-pre-processing-74584bb9f8-26s5d\" (UID: \"151eeef3-6fce-4a97-b414-278fffdece35\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.448587 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.448563 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151eeef3-6fce-4a97-b414-278fffdece35-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-26s5d\" (UID: \"151eeef3-6fce-4a97-b414-278fffdece35\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.466544 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.466463 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f8wq\" (UniqueName: \"kubernetes.io/projected/151eeef3-6fce-4a97-b414-278fffdece35-kube-api-access-5f8wq\") pod \"payload-pre-processing-74584bb9f8-26s5d\" (UID: \"151eeef3-6fce-4a97-b414-278fffdece35\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.521063 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.521025 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:15.669432 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:15.669400 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-26s5d"] Jul 16 00:50:15.671929 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:50:15.671899 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151eeef3_6fce_4a97_b414_278fffdece35.slice/crio-33281762f84b44a45081742e7cb640c78fb25f16cf737998ce7085d157701aa7 WatchSource:0}: Error finding container 33281762f84b44a45081742e7cb640c78fb25f16cf737998ce7085d157701aa7: Status 404 returned error can't find the container with id 33281762f84b44a45081742e7cb640c78fb25f16cf737998ce7085d157701aa7 Jul 16 00:50:16.416701 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:16.416615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" event={"ID":"151eeef3-6fce-4a97-b414-278fffdece35","Type":"ContainerStarted","Data":"33281762f84b44a45081742e7cb640c78fb25f16cf737998ce7085d157701aa7"} Jul 16 00:50:17.423245 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:17.423206 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" event={"ID":"151eeef3-6fce-4a97-b414-278fffdece35","Type":"ContainerStarted","Data":"d3514bbe922c8e7ce643a6f44b9eff2c4bb8773388d9cfb650a367015f7b5597"} Jul 16 00:50:17.423619 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:17.423265 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:17.456880 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:17.456825 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" podStartSLOduration=1.135828374 podStartE2EDuration="2.456805173s" totalImagesPullingTime="1.320976799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:50:17.456274857 +0000 UTC m=+596.378323693" watchObservedRunningTime="2026-07-16 00:50:17.456805173 +0000 UTC m=+596.378853990" Jul 16 00:50:21.491962 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:21.491933 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:50:21.492559 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:21.492543 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:50:28.431389 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:28.431348 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-26s5d" Jul 16 00:50:42.232026 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.231989 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb"] Jul 16 00:50:42.235649 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.235617 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.239081 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.239053 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 00:50:42.239263 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.239059 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-scpnw\"" Jul 16 00:50:42.239339 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.239059 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 16 00:50:42.239414 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.239116 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 00:50:42.246100 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.246067 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb"] Jul 16 00:50:42.261008 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.260973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.261008 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.261006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.261270 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.261034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbcw6\" (UniqueName: \"kubernetes.io/projected/669b6717-cabb-4ae9-8f0d-d5559cd4c036-kube-api-access-hbcw6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.261270 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.261156 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.261270 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.261221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/669b6717-cabb-4ae9-8f0d-d5559cd4c036-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.261392 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.261271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.362542 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.362502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/669b6717-cabb-4ae9-8f0d-d5559cd4c036-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.362744 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.362563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.362744 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.362610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.362744 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.362630 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.362744 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.362658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbcw6\" (UniqueName: \"kubernetes.io/projected/669b6717-cabb-4ae9-8f0d-d5559cd4c036-kube-api-access-hbcw6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.362744 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.362726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.363087 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.363058 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.363209 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.363087 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.363209 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.363131 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.364976 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.364952 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/669b6717-cabb-4ae9-8f0d-d5559cd4c036-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.365055 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.365040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/669b6717-cabb-4ae9-8f0d-d5559cd4c036-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.372462 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.372438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbcw6\" (UniqueName: \"kubernetes.io/projected/669b6717-cabb-4ae9-8f0d-d5559cd4c036-kube-api-access-hbcw6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb\" (UID: \"669b6717-cabb-4ae9-8f0d-d5559cd4c036\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.548347 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.548257 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:42.686071 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.686039 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb"] Jul 16 00:50:42.687357 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:50:42.687329 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669b6717_cabb_4ae9_8f0d_d5559cd4c036.slice/crio-3e6babd9c707f25141f251dbed5de5a9c54a1efc8c883ca83f3af74882cb91ee WatchSource:0}: Error finding container 3e6babd9c707f25141f251dbed5de5a9c54a1efc8c883ca83f3af74882cb91ee: Status 404 returned error can't find the container with id 3e6babd9c707f25141f251dbed5de5a9c54a1efc8c883ca83f3af74882cb91ee Jul 16 00:50:42.688654 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:42.688637 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:50:43.559928 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:43.559838 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" event={"ID":"669b6717-cabb-4ae9-8f0d-d5559cd4c036","Type":"ContainerStarted","Data":"3e6babd9c707f25141f251dbed5de5a9c54a1efc8c883ca83f3af74882cb91ee"} Jul 16 00:50:44.567197 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:44.567137 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" event={"ID":"669b6717-cabb-4ae9-8f0d-d5559cd4c036","Type":"ContainerStarted","Data":"3adc854dd9726c2dfc515d5b86acb103b3f072aec9692dc9396d5c5439dfa4de"} Jul 16 00:50:44.584493 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:44.584422 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" podStartSLOduration=1.395129853 podStartE2EDuration="2.584402887s" totalImagesPullingTime="1.189273034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:50:44.583464172 +0000 UTC m=+623.505512989" watchObservedRunningTime="2026-07-16 00:50:44.584402887 +0000 UTC m=+623.506451704" Jul 16 00:50:52.548736 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:52.548694 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:52.549261 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:52.548768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:52.566090 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:52.566060 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:50:52.625535 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:50:52.625503 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb" Jul 16 00:51:14.628242 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.628205 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz"] Jul 16 00:51:14.633779 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.633742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.636616 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.636589 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 16 00:51:14.648657 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.648628 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz"] Jul 16 00:51:14.710787 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.710746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.710963 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.710788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.710963 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.710879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.710963 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.710928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.711140 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.710995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj5qs\" (UniqueName: \"kubernetes.io/projected/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-kube-api-access-mj5qs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.711140 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.711092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.811903 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.811864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.811924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.811973 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj5qs\" (UniqueName: \"kubernetes.io/projected/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-kube-api-access-mj5qs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.812024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812067 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.812053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812281 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.812237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812405 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.812384 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812505 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.812483 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.812633 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.812610 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.814386 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.814366 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.814759 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.814737 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.820782 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.820763 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj5qs\" (UniqueName: \"kubernetes.io/projected/88bd1b07-2c8b-42a1-bec1-9a3a5338807c-kube-api-access-mj5qs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz\" (UID: \"88bd1b07-2c8b-42a1-bec1-9a3a5338807c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:14.945918 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:14.945826 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:15.076847 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:15.076815 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz"] Jul 16 00:51:15.078526 ip-10-0-141-73 kubenswrapper[2572]: W0716 00:51:15.078505 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bd1b07_2c8b_42a1_bec1_9a3a5338807c.slice/crio-b048e1afd839c8ef60ed5ef592108fc4b46edeff0928a18c32aef4b5db7b8475 WatchSource:0}: Error finding container b048e1afd839c8ef60ed5ef592108fc4b46edeff0928a18c32aef4b5db7b8475: Status 404 returned error can't find the container with id b048e1afd839c8ef60ed5ef592108fc4b46edeff0928a18c32aef4b5db7b8475 Jul 16 00:51:15.735625 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:15.735584 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" event={"ID":"88bd1b07-2c8b-42a1-bec1-9a3a5338807c","Type":"ContainerStarted","Data":"807602c53b9a3bad1d3234fcb49de99a923b7b17a97406b4757d0f0bb73248b9"} Jul 16 00:51:15.736119 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:15.735652 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" event={"ID":"88bd1b07-2c8b-42a1-bec1-9a3a5338807c","Type":"ContainerStarted","Data":"b048e1afd839c8ef60ed5ef592108fc4b46edeff0928a18c32aef4b5db7b8475"} Jul 16 00:51:15.752691 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:15.752636 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" podStartSLOduration=1.579459209 podStartE2EDuration="1.752618687s" totalImagesPullingTime="173.159478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:51:15.751860035 +0000 UTC m=+654.673908852" watchObservedRunningTime="2026-07-16 00:51:15.752618687 +0000 UTC m=+654.674667511" Jul 16 00:51:24.946842 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:24.946796 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:24.947495 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:24.946902 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:24.959475 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:24.959449 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:51:25.797918 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:51:25.797875 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz" Jul 16 00:52:41.306523 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.306489 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6674bf9cd7-ntqgp"] Jul 16 00:52:41.307038 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.306728 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" podUID="dd092050-fc76-42b6-b170-1f81d683bf31" containerName="authorino" containerID="cri-o://c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b" gracePeriod=30 Jul 16 00:52:41.561666 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.561608 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:52:41.650060 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.650024 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-457nq\" (UniqueName: \"kubernetes.io/projected/dd092050-fc76-42b6-b170-1f81d683bf31-kube-api-access-457nq\") pod \"dd092050-fc76-42b6-b170-1f81d683bf31\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " Jul 16 00:52:41.650252 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.650077 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd092050-fc76-42b6-b170-1f81d683bf31-tls-cert\") pod \"dd092050-fc76-42b6-b170-1f81d683bf31\" (UID: \"dd092050-fc76-42b6-b170-1f81d683bf31\") " Jul 16 00:52:41.652189 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.652151 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd092050-fc76-42b6-b170-1f81d683bf31-kube-api-access-457nq" (OuterVolumeSpecName: "kube-api-access-457nq") pod "dd092050-fc76-42b6-b170-1f81d683bf31" (UID: "dd092050-fc76-42b6-b170-1f81d683bf31"). InnerVolumeSpecName "kube-api-access-457nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:52:41.661591 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.661562 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd092050-fc76-42b6-b170-1f81d683bf31-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dd092050-fc76-42b6-b170-1f81d683bf31" (UID: "dd092050-fc76-42b6-b170-1f81d683bf31"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:52:41.751398 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.751366 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-457nq\" (UniqueName: \"kubernetes.io/projected/dd092050-fc76-42b6-b170-1f81d683bf31-kube-api-access-457nq\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:52:41.751398 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:41.751397 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd092050-fc76-42b6-b170-1f81d683bf31-tls-cert\") on node \"ip-10-0-141-73.ec2.internal\" DevicePath \"\"" Jul 16 00:52:42.177676 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.177637 2572 generic.go:356] "Generic (PLEG): container finished" podID="dd092050-fc76-42b6-b170-1f81d683bf31" containerID="c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b" exitCode=0 Jul 16 00:52:42.177854 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.177698 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" Jul 16 00:52:42.177854 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.177722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" event={"ID":"dd092050-fc76-42b6-b170-1f81d683bf31","Type":"ContainerDied","Data":"c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b"} Jul 16 00:52:42.177854 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.177768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6674bf9cd7-ntqgp" event={"ID":"dd092050-fc76-42b6-b170-1f81d683bf31","Type":"ContainerDied","Data":"0ac6370b1df263eb3ba738a0c6f54f9627cf5c8ff84d0338f0e1011ea3dafa3d"} Jul 16 00:52:42.177854 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.177787 2572 scope.go:117] "RemoveContainer" containerID="c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b" Jul 16 00:52:42.186600 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.186579 2572 scope.go:117] "RemoveContainer" containerID="c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b" Jul 16 00:52:42.186877 ip-10-0-141-73 kubenswrapper[2572]: E0716 00:52:42.186858 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b\": container with ID starting with c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b not found: ID does not exist" containerID="c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b" Jul 16 00:52:42.186929 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.186888 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b"} err="failed to get container status \"c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b\": rpc error: code = NotFound desc = could not find container \"c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b\": container with ID starting with c00681a88bc60d8317a82a4e773bbf082765a7ab25296719b956c27c12c7478b not found: ID does not exist" Jul 16 00:52:42.202115 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.202084 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6674bf9cd7-ntqgp"] Jul 16 00:52:42.206494 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:42.206468 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6674bf9cd7-ntqgp"] Jul 16 00:52:43.602079 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:52:43.602047 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd092050-fc76-42b6-b170-1f81d683bf31" path="/var/lib/kubelet/pods/dd092050-fc76-42b6-b170-1f81d683bf31/volumes" Jul 16 00:55:21.522887 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:55:21.522856 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 00:55:21.523921 ip-10-0-141-73 kubenswrapper[2572]: I0716 00:55:21.523895 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:00:00.164384 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.164307 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq"] Jul 16 01:00:00.164829 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.164685 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd092050-fc76-42b6-b170-1f81d683bf31" containerName="authorino" Jul 16 01:00:00.164829 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.164699 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd092050-fc76-42b6-b170-1f81d683bf31" containerName="authorino" Jul 16 01:00:00.164829 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.164760 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd092050-fc76-42b6-b170-1f81d683bf31" containerName="authorino" Jul 16 01:00:00.167626 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.167610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq" Jul 16 01:00:00.170569 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.170548 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-trkf6\"" Jul 16 01:00:00.175375 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.175348 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq"] Jul 16 01:00:00.178590 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.178572 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq" Jul 16 01:00:00.320077 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.320049 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq"] Jul 16 01:00:00.321655 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:00:00.321633 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78258d8_4ac4_44a8_8c81_ac61d1ad8294.slice/crio-c8d9d93c5c50d2c6a4c3b70c72ae362661d3304bf7155c134b7f1f55208b3c11 WatchSource:0}: Error finding container c8d9d93c5c50d2c6a4c3b70c72ae362661d3304bf7155c134b7f1f55208b3c11: Status 404 returned error can't find the container with id c8d9d93c5c50d2c6a4c3b70c72ae362661d3304bf7155c134b7f1f55208b3c11 Jul 16 01:00:00.323523 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.323503 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:00:00.395746 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:00.395706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq" event={"ID":"c78258d8-4ac4-44a8-8c81-ac61d1ad8294","Type":"ContainerStarted","Data":"c8d9d93c5c50d2c6a4c3b70c72ae362661d3304bf7155c134b7f1f55208b3c11"} Jul 16 01:00:05.424447 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:05.424411 2572 generic.go:356] "Generic (PLEG): container finished" podID="c78258d8-4ac4-44a8-8c81-ac61d1ad8294" containerID="d75ea7b855a75d9cc9849fd08408e46d576cb8a4542db34c5f717b6fd213e188" exitCode=0 Jul 16 01:00:05.424807 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:05.424493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq" event={"ID":"c78258d8-4ac4-44a8-8c81-ac61d1ad8294","Type":"ContainerDied","Data":"d75ea7b855a75d9cc9849fd08408e46d576cb8a4542db34c5f717b6fd213e188"} Jul 16 01:00:06.554316 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:06.554292 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq" Jul 16 01:00:07.436568 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:07.436540 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq" Jul 16 01:00:07.436736 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:07.436540 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-9kwpq" event={"ID":"c78258d8-4ac4-44a8-8c81-ac61d1ad8294","Type":"ContainerDied","Data":"c8d9d93c5c50d2c6a4c3b70c72ae362661d3304bf7155c134b7f1f55208b3c11"} Jul 16 01:00:07.436736 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:07.436667 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8d9d93c5c50d2c6a4c3b70c72ae362661d3304bf7155c134b7f1f55208b3c11" Jul 16 01:00:21.555483 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:21.555446 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:00:21.556701 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:00:21.556676 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:05:21.589092 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:05:21.589062 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:05:21.592147 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:05:21.592116 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:06:24.848782 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.848752 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb"] Jul 16 01:06:24.849156 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.849078 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78258d8-4ac4-44a8-8c81-ac61d1ad8294" containerName="cleanup" Jul 16 01:06:24.849156 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.849089 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78258d8-4ac4-44a8-8c81-ac61d1ad8294" containerName="cleanup" Jul 16 01:06:24.849156 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.849150 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78258d8-4ac4-44a8-8c81-ac61d1ad8294" containerName="cleanup" Jul 16 01:06:24.852039 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.852022 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:24.858082 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.858059 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 01:06:24.858221 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.858130 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ms2nn\"" Jul 16 01:06:24.858805 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.858790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-cefec0b9-serving-cert\"" Jul 16 01:06:24.858884 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.858848 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 01:06:24.884013 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.883989 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb"] Jul 16 01:06:24.915154 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.915123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50b9abb-2e03-43c8-9e19-8cb51351094c-openshift-service-ca\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:24.915290 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.915197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50b9abb-2e03-43c8-9e19-8cb51351094c-maas-api-tls\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:24.915290 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:24.915238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtq99\" (UniqueName: \"kubernetes.io/projected/d50b9abb-2e03-43c8-9e19-8cb51351094c-kube-api-access-mtq99\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.016548 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.016518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50b9abb-2e03-43c8-9e19-8cb51351094c-maas-api-tls\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.016695 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.016565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtq99\" (UniqueName: \"kubernetes.io/projected/d50b9abb-2e03-43c8-9e19-8cb51351094c-kube-api-access-mtq99\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.016695 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.016617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50b9abb-2e03-43c8-9e19-8cb51351094c-openshift-service-ca\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.016695 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:06:25.016668 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-serving-cert: secret "maas-api-e2e-migrate-cefec0b9-serving-cert" not found Jul 16 01:06:25.016796 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:06:25.016730 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50b9abb-2e03-43c8-9e19-8cb51351094c-maas-api-tls podName:d50b9abb-2e03-43c8-9e19-8cb51351094c nodeName:}" failed. No retries permitted until 2026-07-16 01:06:25.516714071 +0000 UTC m=+1564.438762864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d50b9abb-2e03-43c8-9e19-8cb51351094c-maas-api-tls") pod "maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" (UID: "d50b9abb-2e03-43c8-9e19-8cb51351094c") : secret "maas-api-e2e-migrate-cefec0b9-serving-cert" not found Jul 16 01:06:25.017278 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.017262 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d50b9abb-2e03-43c8-9e19-8cb51351094c-openshift-service-ca\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.035161 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.035136 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtq99\" (UniqueName: \"kubernetes.io/projected/d50b9abb-2e03-43c8-9e19-8cb51351094c-kube-api-access-mtq99\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.520854 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.520815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50b9abb-2e03-43c8-9e19-8cb51351094c-maas-api-tls\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.523224 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.523196 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d50b9abb-2e03-43c8-9e19-8cb51351094c-maas-api-tls\") pod \"maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb\" (UID: \"d50b9abb-2e03-43c8-9e19-8cb51351094c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.762097 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.762061 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:25.916200 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.916155 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb"] Jul 16 01:06:25.917578 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:06:25.917551 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50b9abb_2e03_43c8_9e19_8cb51351094c.slice/crio-a732da2f9d7adb6db0153a923a46760f73226b20f078f3fd56620e2dff060154 WatchSource:0}: Error finding container a732da2f9d7adb6db0153a923a46760f73226b20f078f3fd56620e2dff060154: Status 404 returned error can't find the container with id a732da2f9d7adb6db0153a923a46760f73226b20f078f3fd56620e2dff060154 Jul 16 01:06:25.918864 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:25.918846 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:06:26.360328 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:26.360294 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" event={"ID":"d50b9abb-2e03-43c8-9e19-8cb51351094c","Type":"ContainerStarted","Data":"a732da2f9d7adb6db0153a923a46760f73226b20f078f3fd56620e2dff060154"} Jul 16 01:06:28.372686 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:28.372649 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" event={"ID":"d50b9abb-2e03-43c8-9e19-8cb51351094c","Type":"ContainerStarted","Data":"1e0b01ddd130ac8d4a2ba2ca1c63ae938c5a7ee4efe9e95787c094f9edd9d6ab"} Jul 16 01:06:28.373066 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:28.372764 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:06:28.402497 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:28.402450 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" podStartSLOduration=2.127863797 podStartE2EDuration="4.402436289s" totalImagesPullingTime="2.274572492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:06:28.400433635 +0000 UTC m=+1567.322482449" watchObservedRunningTime="2026-07-16 01:06:28.402436289 +0000 UTC m=+1567.324485113" Jul 16 01:06:34.384109 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:06:34.384075 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb" Jul 16 01:08:33.334800 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.334728 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl"] Jul 16 01:08:33.338304 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.338278 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.340757 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.340737 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cdf52386-serving-cert\"" Jul 16 01:08:33.356354 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.356324 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl"] Jul 16 01:08:33.431643 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.431601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5s2d\" (UniqueName: \"kubernetes.io/projected/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-kube-api-access-m5s2d\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.431643 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.431642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-openshift-service-ca\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.431848 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.431665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-maas-api-tls\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.532712 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.532670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5s2d\" (UniqueName: \"kubernetes.io/projected/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-kube-api-access-m5s2d\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.532712 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.532714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-openshift-service-ca\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.532918 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.532743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-maas-api-tls\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.532953 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:08:33.532928 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-serving-cert: secret "maas-api-e2e-mt-cdf52386-serving-cert" not found Jul 16 01:08:33.533037 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:08:33.533026 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-maas-api-tls podName:47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e nodeName:}" failed. No retries permitted until 2026-07-16 01:08:34.033008147 +0000 UTC m=+1692.955056940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-maas-api-tls") pod "maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" (UID: "47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e") : secret "maas-api-e2e-mt-cdf52386-serving-cert" not found Jul 16 01:08:33.533406 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.533388 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-openshift-service-ca\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:33.549872 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:33.549842 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5s2d\" (UniqueName: \"kubernetes.io/projected/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-kube-api-access-m5s2d\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:34.036983 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:34.036952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-maas-api-tls\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:34.039470 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:34.039437 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e-maas-api-tls\") pod \"maas-api-e2e-mt-cdf52386-644d47dcf-n2znl\" (UID: \"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:34.248991 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:34.248955 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:34.402154 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:34.402128 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl"] Jul 16 01:08:34.404056 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:08:34.404029 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a45e1a_6d0d_4bcf_bdcf_fe9550b2f01e.slice/crio-e67b79e89b204d536409c288e9409f82dcc1478c1419f5a9fc8ab3d611cef9c4 WatchSource:0}: Error finding container e67b79e89b204d536409c288e9409f82dcc1478c1419f5a9fc8ab3d611cef9c4: Status 404 returned error can't find the container with id e67b79e89b204d536409c288e9409f82dcc1478c1419f5a9fc8ab3d611cef9c4 Jul 16 01:08:35.024469 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:35.024426 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" event={"ID":"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e","Type":"ContainerStarted","Data":"139491b0bcb7125b8486379f2fe2dbfdc888dfe6bf27ec48a4fab55fbe77ce5f"} Jul 16 01:08:35.024640 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:35.024486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" event={"ID":"47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e","Type":"ContainerStarted","Data":"e67b79e89b204d536409c288e9409f82dcc1478c1419f5a9fc8ab3d611cef9c4"} Jul 16 01:08:35.024640 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:35.024537 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:08:35.051418 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:35.051331 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" podStartSLOduration=1.660944441 podStartE2EDuration="2.051316802s" totalImagesPullingTime="390.372361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:08:35.049882885 +0000 UTC m=+1693.971931701" watchObservedRunningTime="2026-07-16 01:08:35.051316802 +0000 UTC m=+1693.973365617" Jul 16 01:08:41.035221 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:08:41.035161 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cdf52386-644d47dcf-n2znl" Jul 16 01:10:09.748888 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.748856 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5"] Jul 16 01:10:09.752558 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.752530 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.755076 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.755049 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7d5e85-serving-cert\"" Jul 16 01:10:09.768890 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.768858 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5"] Jul 16 01:10:09.874141 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.874096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4r5m\" (UniqueName: \"kubernetes.io/projected/e897f6e8-89f6-460c-92d1-28e4645122dd-kube-api-access-w4r5m\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.874397 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.874165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e897f6e8-89f6-460c-92d1-28e4645122dd-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.874397 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.874245 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e897f6e8-89f6-460c-92d1-28e4645122dd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.975676 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.975640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4r5m\" (UniqueName: \"kubernetes.io/projected/e897f6e8-89f6-460c-92d1-28e4645122dd-kube-api-access-w4r5m\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.975676 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.975688 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e897f6e8-89f6-460c-92d1-28e4645122dd-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.975895 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.975713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e897f6e8-89f6-460c-92d1-28e4645122dd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.976362 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.976337 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e897f6e8-89f6-460c-92d1-28e4645122dd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.978210 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.978170 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e897f6e8-89f6-460c-92d1-28e4645122dd-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:09.983923 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:09.983888 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4r5m\" (UniqueName: \"kubernetes.io/projected/e897f6e8-89f6-460c-92d1-28e4645122dd-kube-api-access-w4r5m\") pod \"maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5\" (UID: \"e897f6e8-89f6-460c-92d1-28e4645122dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:10.063978 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:10.063888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:10.200022 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:10.199992 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5"] Jul 16 01:10:10.202755 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:10:10.202728 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode897f6e8_89f6_460c_92d1_28e4645122dd.slice/crio-dac4d0ccd1c027ad3b316bda6e643dac92d7309dd37e424fa12fdf738d6010a0 WatchSource:0}: Error finding container dac4d0ccd1c027ad3b316bda6e643dac92d7309dd37e424fa12fdf738d6010a0: Status 404 returned error can't find the container with id dac4d0ccd1c027ad3b316bda6e643dac92d7309dd37e424fa12fdf738d6010a0 Jul 16 01:10:10.513961 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:10.513925 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" event={"ID":"e897f6e8-89f6-460c-92d1-28e4645122dd","Type":"ContainerStarted","Data":"dac4d0ccd1c027ad3b316bda6e643dac92d7309dd37e424fa12fdf738d6010a0"} Jul 16 01:10:11.521560 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:11.521523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" event={"ID":"e897f6e8-89f6-460c-92d1-28e4645122dd","Type":"ContainerStarted","Data":"7a265ff38e512ba98b5afe5f88d95126994a5c34d8ea3c1ced6bf9bd81898ac2"} Jul 16 01:10:11.521971 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:11.521658 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:11.552581 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:11.552515 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" podStartSLOduration=2.03604377 podStartE2EDuration="2.552493059s" totalImagesPullingTime="516.449289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:10:11.55235428 +0000 UTC m=+1790.474403096" watchObservedRunningTime="2026-07-16 01:10:11.552493059 +0000 UTC m=+1790.474541874" Jul 16 01:10:17.531830 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.531749 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5" Jul 16 01:10:17.886190 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.886146 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb"] Jul 16 01:10:17.889636 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.889618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:17.891758 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.891737 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e5854b-serving-cert\"" Jul 16 01:10:17.906712 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.906688 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb"] Jul 16 01:10:17.937510 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.937484 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87dfb077-8768-4b3f-bcca-509e82c92ece-maas-api-tls\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:17.937664 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.937523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lcrp\" (UniqueName: \"kubernetes.io/projected/87dfb077-8768-4b3f-bcca-509e82c92ece-kube-api-access-7lcrp\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:17.937664 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:17.937549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87dfb077-8768-4b3f-bcca-509e82c92ece-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.038030 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.037987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87dfb077-8768-4b3f-bcca-509e82c92ece-maas-api-tls\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.038030 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.038037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lcrp\" (UniqueName: \"kubernetes.io/projected/87dfb077-8768-4b3f-bcca-509e82c92ece-kube-api-access-7lcrp\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.038330 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:10:18.038136 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-serving-cert: secret "maas-api-e2e-inf-b-e5854b-serving-cert" not found Jul 16 01:10:18.038330 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.038163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87dfb077-8768-4b3f-bcca-509e82c92ece-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.038330 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:10:18.038243 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87dfb077-8768-4b3f-bcca-509e82c92ece-maas-api-tls podName:87dfb077-8768-4b3f-bcca-509e82c92ece nodeName:}" failed. No retries permitted until 2026-07-16 01:10:18.538221952 +0000 UTC m=+1797.460270745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/87dfb077-8768-4b3f-bcca-509e82c92ece-maas-api-tls") pod "maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" (UID: "87dfb077-8768-4b3f-bcca-509e82c92ece") : secret "maas-api-e2e-inf-b-e5854b-serving-cert" not found Jul 16 01:10:18.038765 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.038744 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87dfb077-8768-4b3f-bcca-509e82c92ece-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.046475 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.046455 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lcrp\" (UniqueName: \"kubernetes.io/projected/87dfb077-8768-4b3f-bcca-509e82c92ece-kube-api-access-7lcrp\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.541253 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.541219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87dfb077-8768-4b3f-bcca-509e82c92ece-maas-api-tls\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.543766 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.543741 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87dfb077-8768-4b3f-bcca-509e82c92ece-maas-api-tls\") pod \"maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb\" (UID: \"87dfb077-8768-4b3f-bcca-509e82c92ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.800443 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.800343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:18.949581 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:18.949556 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb"] Jul 16 01:10:18.951282 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:10:18.951254 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87dfb077_8768_4b3f_bcca_509e82c92ece.slice/crio-ed70fb4ebd80e7d95cd2c4c3a0800acb3b0b1f4a44288e649eeb4720bfe29ae6 WatchSource:0}: Error finding container ed70fb4ebd80e7d95cd2c4c3a0800acb3b0b1f4a44288e649eeb4720bfe29ae6: Status 404 returned error can't find the container with id ed70fb4ebd80e7d95cd2c4c3a0800acb3b0b1f4a44288e649eeb4720bfe29ae6 Jul 16 01:10:19.563196 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:19.563149 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" event={"ID":"87dfb077-8768-4b3f-bcca-509e82c92ece","Type":"ContainerStarted","Data":"b96e68c8709c1d405692d3427a5f68362ffd10614efa9a6f6a2b6f3ab085b23d"} Jul 16 01:10:19.563566 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:19.563217 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" event={"ID":"87dfb077-8768-4b3f-bcca-509e82c92ece","Type":"ContainerStarted","Data":"ed70fb4ebd80e7d95cd2c4c3a0800acb3b0b1f4a44288e649eeb4720bfe29ae6"} Jul 16 01:10:19.563566 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:19.563357 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:10:19.602048 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:19.601980 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" podStartSLOduration=2.175802197 podStartE2EDuration="2.60195944s" totalImagesPullingTime="426.157243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:10:19.600143232 +0000 UTC m=+1798.522192066" watchObservedRunningTime="2026-07-16 01:10:19.60195944 +0000 UTC m=+1798.524008255" Jul 16 01:10:21.621604 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:21.621577 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:10:21.625623 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:21.625596 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:10:25.574314 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:10:25.574286 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb" Jul 16 01:12:35.587432 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.587401 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls"] Jul 16 01:12:35.590807 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.590784 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.593421 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.593402 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f1f83d-serving-cert\"" Jul 16 01:12:35.606148 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.606125 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls"] Jul 16 01:12:35.766999 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.766958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe73c1d1-350d-49ce-9da0-384e6c001a7c-openshift-service-ca\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.767210 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.767105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe73c1d1-350d-49ce-9da0-384e6c001a7c-maas-api-tls\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.767210 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.767145 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9cm\" (UniqueName: \"kubernetes.io/projected/fe73c1d1-350d-49ce-9da0-384e6c001a7c-kube-api-access-7w9cm\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.868408 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.868371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe73c1d1-350d-49ce-9da0-384e6c001a7c-maas-api-tls\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.868408 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.868413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9cm\" (UniqueName: \"kubernetes.io/projected/fe73c1d1-350d-49ce-9da0-384e6c001a7c-kube-api-access-7w9cm\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.868675 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.868467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe73c1d1-350d-49ce-9da0-384e6c001a7c-openshift-service-ca\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.869407 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.869380 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe73c1d1-350d-49ce-9da0-384e6c001a7c-openshift-service-ca\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.871138 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.871109 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe73c1d1-350d-49ce-9da0-384e6c001a7c-maas-api-tls\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.879712 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.879685 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9cm\" (UniqueName: \"kubernetes.io/projected/fe73c1d1-350d-49ce-9da0-384e6c001a7c-kube-api-access-7w9cm\") pod \"maas-api-e2e-api-a-f1f83d-cbc466777-rvhls\" (UID: \"fe73c1d1-350d-49ce-9da0-384e6c001a7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:35.902356 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:35.902333 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:36.041064 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:36.041033 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls"] Jul 16 01:12:36.042269 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:12:36.042239 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe73c1d1_350d_49ce_9da0_384e6c001a7c.slice/crio-28161173e934e29915d3789ef88cbf441e70b72a833cf96f4abf7d36aeb97957 WatchSource:0}: Error finding container 28161173e934e29915d3789ef88cbf441e70b72a833cf96f4abf7d36aeb97957: Status 404 returned error can't find the container with id 28161173e934e29915d3789ef88cbf441e70b72a833cf96f4abf7d36aeb97957 Jul 16 01:12:36.043801 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:36.043779 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:12:36.281213 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:36.281115 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" event={"ID":"fe73c1d1-350d-49ce-9da0-384e6c001a7c","Type":"ContainerStarted","Data":"28161173e934e29915d3789ef88cbf441e70b72a833cf96f4abf7d36aeb97957"} Jul 16 01:12:37.288868 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:37.288833 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" event={"ID":"fe73c1d1-350d-49ce-9da0-384e6c001a7c","Type":"ContainerStarted","Data":"597c8c029afb90dcc37c46f26f444aa5cd551a14b46fcf6e76b30c9a370cc0f3"} Jul 16 01:12:37.289279 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:37.288899 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:37.313269 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:37.313219 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" podStartSLOduration=1.850036737 podStartE2EDuration="2.313203326s" totalImagesPullingTime="463.166589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:37.311351573 +0000 UTC m=+1936.233400407" watchObservedRunningTime="2026-07-16 01:12:37.313203326 +0000 UTC m=+1936.235252138" Jul 16 01:12:43.299552 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.299520 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f1f83d-cbc466777-rvhls" Jul 16 01:12:43.668363 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.668320 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q"] Jul 16 01:12:43.671975 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.671953 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.674329 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.674313 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2814a2-serving-cert\"" Jul 16 01:12:43.694386 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.694355 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q"] Jul 16 01:12:43.740541 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.740496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsdpd\" (UniqueName: \"kubernetes.io/projected/0f519e12-d44f-474b-947e-df4b57e94c1d-kube-api-access-lsdpd\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.740725 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.740574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f519e12-d44f-474b-947e-df4b57e94c1d-maas-api-tls\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.740725 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.740605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f519e12-d44f-474b-947e-df4b57e94c1d-openshift-service-ca\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.841916 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.841868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f519e12-d44f-474b-947e-df4b57e94c1d-maas-api-tls\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.842121 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.841926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f519e12-d44f-474b-947e-df4b57e94c1d-openshift-service-ca\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.842121 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.841979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsdpd\" (UniqueName: \"kubernetes.io/projected/0f519e12-d44f-474b-947e-df4b57e94c1d-kube-api-access-lsdpd\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.842121 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:12:43.842039 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-serving-cert: secret "maas-api-e2e-api-b-2814a2-serving-cert" not found Jul 16 01:12:43.842354 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:12:43.842149 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f519e12-d44f-474b-947e-df4b57e94c1d-maas-api-tls podName:0f519e12-d44f-474b-947e-df4b57e94c1d nodeName:}" failed. No retries permitted until 2026-07-16 01:12:44.342128565 +0000 UTC m=+1943.264177377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0f519e12-d44f-474b-947e-df4b57e94c1d-maas-api-tls") pod "maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" (UID: "0f519e12-d44f-474b-947e-df4b57e94c1d") : secret "maas-api-e2e-api-b-2814a2-serving-cert" not found Jul 16 01:12:43.842684 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.842662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f519e12-d44f-474b-947e-df4b57e94c1d-openshift-service-ca\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:43.855658 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:43.855629 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsdpd\" (UniqueName: \"kubernetes.io/projected/0f519e12-d44f-474b-947e-df4b57e94c1d-kube-api-access-lsdpd\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:44.346847 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:44.346799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f519e12-d44f-474b-947e-df4b57e94c1d-maas-api-tls\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:44.349463 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:44.349428 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f519e12-d44f-474b-947e-df4b57e94c1d-maas-api-tls\") pod \"maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q\" (UID: \"0f519e12-d44f-474b-947e-df4b57e94c1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:44.583759 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:44.583721 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:44.722058 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:44.722034 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q"] Jul 16 01:12:44.724343 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:12:44.724315 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f519e12_d44f_474b_947e_df4b57e94c1d.slice/crio-0aba4f828d01559a7ab0600ebeb25333119b0eb94bd6e66cd8baa7dd51d59d7b WatchSource:0}: Error finding container 0aba4f828d01559a7ab0600ebeb25333119b0eb94bd6e66cd8baa7dd51d59d7b: Status 404 returned error can't find the container with id 0aba4f828d01559a7ab0600ebeb25333119b0eb94bd6e66cd8baa7dd51d59d7b Jul 16 01:12:45.332841 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:45.332749 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" event={"ID":"0f519e12-d44f-474b-947e-df4b57e94c1d","Type":"ContainerStarted","Data":"8502e1d5242a869137249596607568592ca10c0a3018e7fa10f2d12903ca2f53"} Jul 16 01:12:45.332841 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:45.332812 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" event={"ID":"0f519e12-d44f-474b-947e-df4b57e94c1d","Type":"ContainerStarted","Data":"0aba4f828d01559a7ab0600ebeb25333119b0eb94bd6e66cd8baa7dd51d59d7b"} Jul 16 01:12:45.333041 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:45.332870 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:12:45.351756 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:45.351703 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" podStartSLOduration=2.01813747 podStartE2EDuration="2.351685821s" totalImagesPullingTime="333.548351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:45.34899842 +0000 UTC m=+1944.271047249" watchObservedRunningTime="2026-07-16 01:12:45.351685821 +0000 UTC m=+1944.273734636" Jul 16 01:12:51.343342 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:12:51.343311 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q" Jul 16 01:13:25.953591 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:25.953520 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb"] Jul 16 01:13:25.957107 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:25.957086 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:25.959325 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:25.959307 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f9f50d-serving-cert\"" Jul 16 01:13:25.971171 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:25.971150 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb"] Jul 16 01:13:26.129383 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.129343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrwrl\" (UniqueName: \"kubernetes.io/projected/b4547890-635b-4db6-8ad1-715dd76dffde-kube-api-access-nrwrl\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.129566 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.129413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4547890-635b-4db6-8ad1-715dd76dffde-maas-api-tls\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.129566 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.129457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4547890-635b-4db6-8ad1-715dd76dffde-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.230768 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.230675 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4547890-635b-4db6-8ad1-715dd76dffde-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.230768 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.230742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrwrl\" (UniqueName: \"kubernetes.io/projected/b4547890-635b-4db6-8ad1-715dd76dffde-kube-api-access-nrwrl\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.230970 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.230790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4547890-635b-4db6-8ad1-715dd76dffde-maas-api-tls\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.231389 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.231367 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4547890-635b-4db6-8ad1-715dd76dffde-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.233319 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.233296 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4547890-635b-4db6-8ad1-715dd76dffde-maas-api-tls\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.254733 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.254697 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrwrl\" (UniqueName: \"kubernetes.io/projected/b4547890-635b-4db6-8ad1-715dd76dffde-kube-api-access-nrwrl\") pod \"maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb\" (UID: \"b4547890-635b-4db6-8ad1-715dd76dffde\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.267575 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.267544 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:26.414027 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.413983 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb"] Jul 16 01:13:26.415317 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:13:26.415289 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4547890_635b_4db6_8ad1_715dd76dffde.slice/crio-7c7cf9b912268b673b33e27afbdcfc8bea2623a5e99b8a58b53ec8798fa39fb1 WatchSource:0}: Error finding container 7c7cf9b912268b673b33e27afbdcfc8bea2623a5e99b8a58b53ec8798fa39fb1: Status 404 returned error can't find the container with id 7c7cf9b912268b673b33e27afbdcfc8bea2623a5e99b8a58b53ec8798fa39fb1 Jul 16 01:13:26.554924 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:26.554836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" event={"ID":"b4547890-635b-4db6-8ad1-715dd76dffde","Type":"ContainerStarted","Data":"7c7cf9b912268b673b33e27afbdcfc8bea2623a5e99b8a58b53ec8798fa39fb1"} Jul 16 01:13:27.562239 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:27.562202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" event={"ID":"b4547890-635b-4db6-8ad1-715dd76dffde","Type":"ContainerStarted","Data":"1f06b8584997204cfbe4f3f62bd51682e60c4c8b66665929351af04f4918a31b"} Jul 16 01:13:27.562619 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:27.562317 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:27.584281 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:27.584209 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" podStartSLOduration=2.240155668 podStartE2EDuration="2.584163303s" totalImagesPullingTime="344.007635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:13:27.582569574 +0000 UTC m=+1986.504618389" watchObservedRunningTime="2026-07-16 01:13:27.584163303 +0000 UTC m=+1986.506212121" Jul 16 01:13:33.574236 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:33.574171 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb" Jul 16 01:13:34.015514 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.015476 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l"] Jul 16 01:13:34.018919 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.018894 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.026332 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.026300 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-628c71-serving-cert\"" Jul 16 01:13:34.036135 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.036102 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l"] Jul 16 01:13:34.093495 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.093455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44c0de01-337b-4ff1-a64e-c65c5aa413ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.093689 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.093521 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44c0de01-337b-4ff1-a64e-c65c5aa413ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.093689 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.093585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x7kf\" (UniqueName: \"kubernetes.io/projected/44c0de01-337b-4ff1-a64e-c65c5aa413ea-kube-api-access-6x7kf\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.194423 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.194386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x7kf\" (UniqueName: \"kubernetes.io/projected/44c0de01-337b-4ff1-a64e-c65c5aa413ea-kube-api-access-6x7kf\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.194598 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.194462 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44c0de01-337b-4ff1-a64e-c65c5aa413ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.194598 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.194491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44c0de01-337b-4ff1-a64e-c65c5aa413ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.194691 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:13:34.194608 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-serving-cert: secret "maas-api-e2e-shared-b-628c71-serving-cert" not found Jul 16 01:13:34.194691 ip-10-0-141-73 kubenswrapper[2572]: E0716 01:13:34.194656 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c0de01-337b-4ff1-a64e-c65c5aa413ea-maas-api-tls podName:44c0de01-337b-4ff1-a64e-c65c5aa413ea nodeName:}" failed. No retries permitted until 2026-07-16 01:13:34.694640534 +0000 UTC m=+1993.616689327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/44c0de01-337b-4ff1-a64e-c65c5aa413ea-maas-api-tls") pod "maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" (UID: "44c0de01-337b-4ff1-a64e-c65c5aa413ea") : secret "maas-api-e2e-shared-b-628c71-serving-cert" not found Jul 16 01:13:34.195136 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.195117 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44c0de01-337b-4ff1-a64e-c65c5aa413ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.215824 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.215791 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x7kf\" (UniqueName: \"kubernetes.io/projected/44c0de01-337b-4ff1-a64e-c65c5aa413ea-kube-api-access-6x7kf\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.697522 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.697488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44c0de01-337b-4ff1-a64e-c65c5aa413ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.699910 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.699887 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44c0de01-337b-4ff1-a64e-c65c5aa413ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l\" (UID: \"44c0de01-337b-4ff1-a64e-c65c5aa413ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:34.933699 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:34.933656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:35.073906 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:35.073841 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l"] Jul 16 01:13:35.076209 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:13:35.076161 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c0de01_337b_4ff1_a64e_c65c5aa413ea.slice/crio-74ca5ebdc7685fa2c477e4084ea65c25ad3a37442ec2754f649497fa22ddc023 WatchSource:0}: Error finding container 74ca5ebdc7685fa2c477e4084ea65c25ad3a37442ec2754f649497fa22ddc023: Status 404 returned error can't find the container with id 74ca5ebdc7685fa2c477e4084ea65c25ad3a37442ec2754f649497fa22ddc023 Jul 16 01:13:35.605924 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:35.605890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" event={"ID":"44c0de01-337b-4ff1-a64e-c65c5aa413ea","Type":"ContainerStarted","Data":"47036a83dc26dd3821c216d60125a4ed28d3770bb1700f050d29c8813b44fd38"} Jul 16 01:13:35.606103 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:35.605933 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" event={"ID":"44c0de01-337b-4ff1-a64e-c65c5aa413ea","Type":"ContainerStarted","Data":"74ca5ebdc7685fa2c477e4084ea65c25ad3a37442ec2754f649497fa22ddc023"} Jul 16 01:13:35.606103 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:35.606022 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:13:35.641667 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:35.641607 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" podStartSLOduration=2.2630027200000002 podStartE2EDuration="2.641589952s" totalImagesPullingTime="378.587232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:13:35.637511183 +0000 UTC m=+1994.559560120" watchObservedRunningTime="2026-07-16 01:13:35.641589952 +0000 UTC m=+1994.563638766" Jul 16 01:13:41.617850 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:13:41.617822 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l" Jul 16 01:15:00.149285 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.149191 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d"] Jul 16 01:15:00.152969 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.152944 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" Jul 16 01:15:00.154641 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.154615 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b"] Jul 16 01:15:00.155677 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.155660 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-trkf6\"" Jul 16 01:15:00.158390 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.158369 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr"] Jul 16 01:15:00.158470 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.158459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" Jul 16 01:15:00.162301 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.162274 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" Jul 16 01:15:00.164506 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.164487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" Jul 16 01:15:00.170952 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.170931 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d"] Jul 16 01:15:00.174795 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.174769 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b"] Jul 16 01:15:00.175350 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.175316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" Jul 16 01:15:00.188793 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.188761 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh"] Jul 16 01:15:00.193871 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.193470 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh" Jul 16 01:15:00.194160 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.194123 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr"] Jul 16 01:15:00.213346 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.213319 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985"] Jul 16 01:15:00.217962 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.217924 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck"] Jul 16 01:15:00.218438 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.218417 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985" Jul 16 01:15:00.219090 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.218922 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" Jul 16 01:15:00.222818 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.222795 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" Jul 16 01:15:00.223331 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.223314 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh"] Jul 16 01:15:00.235209 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.235151 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt"] Jul 16 01:15:00.237157 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.236976 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh" Jul 16 01:15:00.246225 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.246197 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck"] Jul 16 01:15:00.246598 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.246581 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt" Jul 16 01:15:00.248672 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.248610 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985"] Jul 16 01:15:00.255332 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.254917 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt"] Jul 16 01:15:00.295579 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.295393 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985" Jul 16 01:15:00.314363 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.310905 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" Jul 16 01:15:00.332465 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.332052 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt" Jul 16 01:15:00.399243 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.398687 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d"] Jul 16 01:15:00.399428 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:15:00.399339 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45c26bd_1998_49ce_ae55_0ecc42f506fc.slice/crio-5cfd6a4afeb456d16822f2f58d0b1deedd94afda2c532fb088d474402dbb1169 WatchSource:0}: Error finding container 5cfd6a4afeb456d16822f2f58d0b1deedd94afda2c532fb088d474402dbb1169: Status 404 returned error can't find the container with id 5cfd6a4afeb456d16822f2f58d0b1deedd94afda2c532fb088d474402dbb1169 Jul 16 01:15:00.424038 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.423925 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b"] Jul 16 01:15:00.436751 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:15:00.436719 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08aa0ae8_70b3_4019_a004_02dd1e2a83ec.slice/crio-eafdebf6c8a517250278a4d7b46ab26abbf39ea63f887e4119975631599fa60c WatchSource:0}: Error finding container eafdebf6c8a517250278a4d7b46ab26abbf39ea63f887e4119975631599fa60c: Status 404 returned error can't find the container with id eafdebf6c8a517250278a4d7b46ab26abbf39ea63f887e4119975631599fa60c Jul 16 01:15:00.504645 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.504426 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr"] Jul 16 01:15:00.509508 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:15:00.509473 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6411a95_86c4_4988_9fb9_4c42aff4ddf1.slice/crio-2931c48a76d166b5173f7d3387556792b3dbeff7e91f356d15267f2ae87f012b WatchSource:0}: Error finding container 2931c48a76d166b5173f7d3387556792b3dbeff7e91f356d15267f2ae87f012b: Status 404 returned error can't find the container with id 2931c48a76d166b5173f7d3387556792b3dbeff7e91f356d15267f2ae87f012b Jul 16 01:15:00.520201 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.520146 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh"] Jul 16 01:15:00.523736 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:15:00.523709 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c512be7_355d_424f_a74f_bc5ef319d5f7.slice/crio-753d58bd6e0d009a00d0cf791034bb0ccb532b4f9721e23c7fdc93814d727947 WatchSource:0}: Error finding container 753d58bd6e0d009a00d0cf791034bb0ccb532b4f9721e23c7fdc93814d727947: Status 404 returned error can't find the container with id 753d58bd6e0d009a00d0cf791034bb0ccb532b4f9721e23c7fdc93814d727947 Jul 16 01:15:00.567683 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.567650 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck"] Jul 16 01:15:00.591656 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.591621 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985"] Jul 16 01:15:00.614543 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:00.614519 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt"] Jul 16 01:15:00.659569 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:15:00.659524 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94eb6328_86c8_4134_9b55_43b972ef7308.slice/crio-702c00cd5fd14cf49140093689bd4e11c88cc8c6fad2ab3cb90bac22fb6e9102 WatchSource:0}: Error finding container 702c00cd5fd14cf49140093689bd4e11c88cc8c6fad2ab3cb90bac22fb6e9102: Status 404 returned error can't find the container with id 702c00cd5fd14cf49140093689bd4e11c88cc8c6fad2ab3cb90bac22fb6e9102 Jul 16 01:15:00.661433 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:15:00.661404 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded259bbf_6875_4a40_9c9c_ac378369d142.slice/crio-dbfaa73b73163b2ea774587fc1aec9577ad7c68db72b1191d5f4c022637fec20 WatchSource:0}: Error finding container dbfaa73b73163b2ea774587fc1aec9577ad7c68db72b1191d5f4c022637fec20: Status 404 returned error can't find the container with id dbfaa73b73163b2ea774587fc1aec9577ad7c68db72b1191d5f4c022637fec20 Jul 16 01:15:01.072440 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.072404 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt" event={"ID":"ed259bbf-6875-4a40-9c9c-ac378369d142","Type":"ContainerStarted","Data":"dbfaa73b73163b2ea774587fc1aec9577ad7c68db72b1191d5f4c022637fec20"} Jul 16 01:15:01.074017 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.073958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh" event={"ID":"7c512be7-355d-424f-a74f-bc5ef319d5f7","Type":"ContainerStarted","Data":"753d58bd6e0d009a00d0cf791034bb0ccb532b4f9721e23c7fdc93814d727947"} Jul 16 01:15:01.076014 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.075808 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" event={"ID":"08aa0ae8-70b3-4019-a004-02dd1e2a83ec","Type":"ContainerStarted","Data":"e0af0cc28208af570b226b2b19d11b5bdf5f81ad2328248504137d818caf45c5"} Jul 16 01:15:01.076014 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.075858 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" event={"ID":"08aa0ae8-70b3-4019-a004-02dd1e2a83ec","Type":"ContainerStarted","Data":"eafdebf6c8a517250278a4d7b46ab26abbf39ea63f887e4119975631599fa60c"} Jul 16 01:15:01.077535 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.077509 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" event={"ID":"105ddd74-e01b-4149-9f2c-ef07282e4678","Type":"ContainerStarted","Data":"1d6c0d189eebaea96b7f4228eae2209395c5aedef0bf1fc67537e6b409b39d36"} Jul 16 01:15:01.077635 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.077552 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" event={"ID":"105ddd74-e01b-4149-9f2c-ef07282e4678","Type":"ContainerStarted","Data":"f0979281ad05662027bac8bb90c26a64d47401ab2f5a8f1e7378c6b0f8d72810"} Jul 16 01:15:01.079068 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.079044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" event={"ID":"e6411a95-86c4-4988-9fb9-4c42aff4ddf1","Type":"ContainerStarted","Data":"2931c48a76d166b5173f7d3387556792b3dbeff7e91f356d15267f2ae87f012b"} Jul 16 01:15:01.080487 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.080465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985" event={"ID":"94eb6328-86c8-4134-9b55-43b972ef7308","Type":"ContainerStarted","Data":"702c00cd5fd14cf49140093689bd4e11c88cc8c6fad2ab3cb90bac22fb6e9102"} Jul 16 01:15:01.088832 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.088808 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" event={"ID":"c45c26bd-1998-49ce-ae55-0ecc42f506fc","Type":"ContainerStarted","Data":"64e5f17809fb97deaa4f12b9216063541bd28cd28608ff96d60f15e9d01ac20d"} Jul 16 01:15:01.088923 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.088872 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" event={"ID":"c45c26bd-1998-49ce-ae55-0ecc42f506fc","Type":"ContainerStarted","Data":"5cfd6a4afeb456d16822f2f58d0b1deedd94afda2c532fb088d474402dbb1169"} Jul 16 01:15:01.092868 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.092829 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" podStartSLOduration=1.092816037 podStartE2EDuration="1.092816037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.09150055 +0000 UTC m=+2080.013549366" watchObservedRunningTime="2026-07-16 01:15:01.092816037 +0000 UTC m=+2080.014864851" Jul 16 01:15:01.104457 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.104404 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" podStartSLOduration=1.10438843 podStartE2EDuration="1.10438843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.103729666 +0000 UTC m=+2080.025778480" watchObservedRunningTime="2026-07-16 01:15:01.10438843 +0000 UTC m=+2080.026437248" Jul 16 01:15:01.117325 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.117277 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" podStartSLOduration=1.117264261 podStartE2EDuration="1.117264261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.116455482 +0000 UTC m=+2080.038504309" watchObservedRunningTime="2026-07-16 01:15:01.117264261 +0000 UTC m=+2080.039313076" Jul 16 01:15:01.133970 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:01.133920 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" podStartSLOduration=1.133905724 podStartE2EDuration="1.133905724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.131039808 +0000 UTC m=+2080.053088644" watchObservedRunningTime="2026-07-16 01:15:01.133905724 +0000 UTC m=+2080.055954539" Jul 16 01:15:02.097282 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.097248 2572 generic.go:356] "Generic (PLEG): container finished" podID="94eb6328-86c8-4134-9b55-43b972ef7308" containerID="4e55d0a07bdbb7fc9ee46b0ac7da93a0e3759ed043e2dc29b446c0414ca2817c" exitCode=0 Jul 16 01:15:02.097649 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.097330 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985" event={"ID":"94eb6328-86c8-4134-9b55-43b972ef7308","Type":"ContainerDied","Data":"4e55d0a07bdbb7fc9ee46b0ac7da93a0e3759ed043e2dc29b446c0414ca2817c"} Jul 16 01:15:02.098962 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.098938 2572 generic.go:356] "Generic (PLEG): container finished" podID="c45c26bd-1998-49ce-ae55-0ecc42f506fc" containerID="64e5f17809fb97deaa4f12b9216063541bd28cd28608ff96d60f15e9d01ac20d" exitCode=0 Jul 16 01:15:02.099088 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.099024 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" event={"ID":"c45c26bd-1998-49ce-ae55-0ecc42f506fc","Type":"ContainerDied","Data":"64e5f17809fb97deaa4f12b9216063541bd28cd28608ff96d60f15e9d01ac20d"} Jul 16 01:15:02.100791 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.100683 2572 generic.go:356] "Generic (PLEG): container finished" podID="ed259bbf-6875-4a40-9c9c-ac378369d142" containerID="19fc6145edd5081a9220946b964fc869226809daba337e3398e6476c0877a21c" exitCode=0 Jul 16 01:15:02.100791 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.100706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt" event={"ID":"ed259bbf-6875-4a40-9c9c-ac378369d142","Type":"ContainerDied","Data":"19fc6145edd5081a9220946b964fc869226809daba337e3398e6476c0877a21c"} Jul 16 01:15:02.102434 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.102413 2572 generic.go:356] "Generic (PLEG): container finished" podID="7c512be7-355d-424f-a74f-bc5ef319d5f7" containerID="51a5841d599e5e114cae09f83456bb76f01d748fc7c2570251d793416433be6d" exitCode=0 Jul 16 01:15:02.102534 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.102494 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh" event={"ID":"7c512be7-355d-424f-a74f-bc5ef319d5f7","Type":"ContainerDied","Data":"51a5841d599e5e114cae09f83456bb76f01d748fc7c2570251d793416433be6d"} Jul 16 01:15:02.103896 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.103872 2572 generic.go:356] "Generic (PLEG): container finished" podID="08aa0ae8-70b3-4019-a004-02dd1e2a83ec" containerID="e0af0cc28208af570b226b2b19d11b5bdf5f81ad2328248504137d818caf45c5" exitCode=0 Jul 16 01:15:02.104056 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.103945 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" event={"ID":"08aa0ae8-70b3-4019-a004-02dd1e2a83ec","Type":"ContainerDied","Data":"e0af0cc28208af570b226b2b19d11b5bdf5f81ad2328248504137d818caf45c5"} Jul 16 01:15:02.105343 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.105325 2572 generic.go:356] "Generic (PLEG): container finished" podID="105ddd74-e01b-4149-9f2c-ef07282e4678" containerID="1d6c0d189eebaea96b7f4228eae2209395c5aedef0bf1fc67537e6b409b39d36" exitCode=0 Jul 16 01:15:02.105501 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.105395 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" event={"ID":"105ddd74-e01b-4149-9f2c-ef07282e4678","Type":"ContainerDied","Data":"1d6c0d189eebaea96b7f4228eae2209395c5aedef0bf1fc67537e6b409b39d36"} Jul 16 01:15:02.107309 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.107099 2572 generic.go:356] "Generic (PLEG): container finished" podID="e6411a95-86c4-4988-9fb9-4c42aff4ddf1" containerID="81c5bf681ab8325dbb0f36fe479113ba07490885ca764a43a97f50d16cfa1a96" exitCode=0 Jul 16 01:15:02.107309 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:02.107163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" event={"ID":"e6411a95-86c4-4988-9fb9-4c42aff4ddf1","Type":"ContainerDied","Data":"81c5bf681ab8325dbb0f36fe479113ba07490885ca764a43a97f50d16cfa1a96"} Jul 16 01:15:03.280587 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:03.280561 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt" Jul 16 01:15:03.332067 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:03.332036 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" Jul 16 01:15:03.373808 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:03.373734 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" Jul 16 01:15:03.421981 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:03.421953 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh" Jul 16 01:15:03.425319 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:03.425296 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" Jul 16 01:15:03.429030 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:03.429009 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985" Jul 16 01:15:03.432415 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:03.432396 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" Jul 16 01:15:04.120380 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.120348 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" Jul 16 01:15:04.120554 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.120345 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b" event={"ID":"08aa0ae8-70b3-4019-a004-02dd1e2a83ec","Type":"ContainerDied","Data":"eafdebf6c8a517250278a4d7b46ab26abbf39ea63f887e4119975631599fa60c"} Jul 16 01:15:04.120554 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.120518 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eafdebf6c8a517250278a4d7b46ab26abbf39ea63f887e4119975631599fa60c" Jul 16 01:15:04.121807 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.121774 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" event={"ID":"105ddd74-e01b-4149-9f2c-ef07282e4678","Type":"ContainerDied","Data":"f0979281ad05662027bac8bb90c26a64d47401ab2f5a8f1e7378c6b0f8d72810"} Jul 16 01:15:04.121931 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.121819 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0979281ad05662027bac8bb90c26a64d47401ab2f5a8f1e7378c6b0f8d72810" Jul 16 01:15:04.121931 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.121782 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck" Jul 16 01:15:04.123350 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.123330 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" Jul 16 01:15:04.123466 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.123365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr" event={"ID":"e6411a95-86c4-4988-9fb9-4c42aff4ddf1","Type":"ContainerDied","Data":"2931c48a76d166b5173f7d3387556792b3dbeff7e91f356d15267f2ae87f012b"} Jul 16 01:15:04.123466 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.123416 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2931c48a76d166b5173f7d3387556792b3dbeff7e91f356d15267f2ae87f012b" Jul 16 01:15:04.124785 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.124761 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985" Jul 16 01:15:04.124913 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.124757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985" event={"ID":"94eb6328-86c8-4134-9b55-43b972ef7308","Type":"ContainerDied","Data":"702c00cd5fd14cf49140093689bd4e11c88cc8c6fad2ab3cb90bac22fb6e9102"} Jul 16 01:15:04.124913 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.124873 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="702c00cd5fd14cf49140093689bd4e11c88cc8c6fad2ab3cb90bac22fb6e9102" Jul 16 01:15:04.126139 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.126116 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" Jul 16 01:15:04.126139 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.126128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d" event={"ID":"c45c26bd-1998-49ce-ae55-0ecc42f506fc","Type":"ContainerDied","Data":"5cfd6a4afeb456d16822f2f58d0b1deedd94afda2c532fb088d474402dbb1169"} Jul 16 01:15:04.126301 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.126164 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cfd6a4afeb456d16822f2f58d0b1deedd94afda2c532fb088d474402dbb1169" Jul 16 01:15:04.127596 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.127578 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt" Jul 16 01:15:04.127695 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.127580 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt" event={"ID":"ed259bbf-6875-4a40-9c9c-ac378369d142","Type":"ContainerDied","Data":"dbfaa73b73163b2ea774587fc1aec9577ad7c68db72b1191d5f4c022637fec20"} Jul 16 01:15:04.127753 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.127704 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbfaa73b73163b2ea774587fc1aec9577ad7c68db72b1191d5f4c022637fec20" Jul 16 01:15:04.128874 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.128851 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh" event={"ID":"7c512be7-355d-424f-a74f-bc5ef319d5f7","Type":"ContainerDied","Data":"753d58bd6e0d009a00d0cf791034bb0ccb532b4f9721e23c7fdc93814d727947"} Jul 16 01:15:04.128978 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.128893 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="753d58bd6e0d009a00d0cf791034bb0ccb532b4f9721e23c7fdc93814d727947" Jul 16 01:15:04.128978 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:04.128929 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh" Jul 16 01:15:21.656786 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:21.656756 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:15:21.663158 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:15:21.663137 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:20:21.697527 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:21.697501 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:20:21.705716 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:21.705696 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ls4xs_cb3e7e13-9f7c-440e-b506-2df6543ff81b/ovn-acl-logging/0.log" Jul 16 01:20:38.394608 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:38.394578 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf8c55d45-2n5p8_62d4b692-f260-4c61-97cb-89fa4cfdc6fe/copy-manifests/0.log" Jul 16 01:20:38.402032 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:38.401997 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf8c55d45-2n5p8_62d4b692-f260-4c61-97cb-89fa4cfdc6fe/manager/0.log" Jul 16 01:20:39.285923 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:39.285885 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-f1f83d-cbc466777-rvhls_fe73c1d1-350d-49ce-9da0-384e6c001a7c/maas-api/0.log" Jul 16 01:20:39.423527 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:39.423498 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-2814a2-6c468b7f94-kfg4q_0f519e12-d44f-474b-947e-df4b57e94c1d/maas-api/0.log" Jul 16 01:20:39.676416 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:39.676383 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-7d5e85-5fcb6dfcf8-sjhr5_e897f6e8-89f6-460c-92d1-28e4645122dd/maas-api/0.log" Jul 16 01:20:39.793388 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:39.793359 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-e5854b-55b655cb8-jzdpb_87dfb077-8768-4b3f-bcca-509e82c92ece/maas-api/0.log" Jul 16 01:20:39.914870 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:39.914833 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-cefec0b9-5fd44bdc87-9ljmb_d50b9abb-2e03-43c8-9e19-8cb51351094c/maas-api/0.log" Jul 16 01:20:40.032451 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:40.032366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-cdf52386-644d47dcf-n2znl_47a45e1a-6d0d-4bcf-bdcf-fe9550b2f01e/maas-api/0.log" Jul 16 01:20:40.149364 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:40.149332 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-f9f50d-86ccc7ddf8-4dqcb_b4547890-635b-4db6-8ad1-715dd76dffde/maas-api/0.log" Jul 16 01:20:40.268625 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:40.268591 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-628c71-67886bcbc6-w7w6l_44c0de01-337b-4ff1-a64e-c65c5aa413ea/maas-api/0.log" Jul 16 01:20:40.390098 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:40.390068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736060-9kwpq_c78258d8-4ac4-44a8-8c81-ac61d1ad8294/cleanup/0.log" Jul 16 01:20:40.614859 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:40.614827 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-241c63c6-29736075-fk985_94eb6328-86c8-4134-9b55-43b972ef7308/cleanup/0.log" Jul 16 01:20:40.728314 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:40.728238 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-api-a-f1f83d-29736075-ccvgt_ed259bbf-6875-4a40-9c9c-ac378369d142/cleanup/0.log" Jul 16 01:20:40.947897 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:40.947861 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-derive-ccc0a86e-29736075-qqs8d_c45c26bd-1998-49ce-ae55-0ecc42f506fc/cleanup/0.log" Jul 16 01:20:41.287337 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:41.287309 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-cefec0b9-29736075-x74rr_e6411a95-86c4-4988-9fb9-4c42aff4ddf1/cleanup/0.log" Jul 16 01:20:41.400122 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:41.400086 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-mt-cdf52386-29736075-gkl6b_08aa0ae8-70b3-4019-a004-02dd1e2a83ec/cleanup/0.log" Jul 16 01:20:41.508136 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:41.508107 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-a-f9f50d-29736075-vpxck_105ddd74-e01b-4149-9f2c-ef07282e4678/cleanup/0.log" Jul 16 01:20:41.622466 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:41.622438 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-628c71-29736075-fd7fh_7c512be7-355d-424f-a74f-bc5ef319d5f7/cleanup/0.log" Jul 16 01:20:42.540076 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.540048 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb_c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9/util/0.log" Jul 16 01:20:42.547110 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.547089 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb_c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9/pull/0.log" Jul 16 01:20:42.554097 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.554077 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb_c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9/extract/0.log" Jul 16 01:20:42.669021 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.668988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw_6ec844ee-2169-465a-9df7-c513e1c90a87/util/0.log" Jul 16 01:20:42.676760 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.676731 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw_6ec844ee-2169-465a-9df7-c513e1c90a87/pull/0.log" Jul 16 01:20:42.683844 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.683823 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw_6ec844ee-2169-465a-9df7-c513e1c90a87/extract/0.log" Jul 16 01:20:42.795999 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.795922 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl_b4ada6c2-90b9-414d-9eb5-d6c87fa482dd/util/0.log" Jul 16 01:20:42.802881 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.802855 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl_b4ada6c2-90b9-414d-9eb5-d6c87fa482dd/pull/0.log" Jul 16 01:20:42.809302 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.809285 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl_b4ada6c2-90b9-414d-9eb5-d6c87fa482dd/extract/0.log" Jul 16 01:20:42.933807 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.933778 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t_4f7e4188-1da6-41a0-8cb3-03fb573facf0/util/0.log" Jul 16 01:20:42.943824 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.943798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t_4f7e4188-1da6-41a0-8cb3-03fb573facf0/pull/0.log" Jul 16 01:20:42.956459 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:42.956439 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t_4f7e4188-1da6-41a0-8cb3-03fb573facf0/extract/0.log" Jul 16 01:20:43.944793 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:43.944715 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cbvcv_929f9487-93ca-4812-986f-dcfc47a94801/manager/0.log" Jul 16 01:20:44.432350 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:44.432314 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fqxs4_851a917f-7ecc-4739-a60f-23bcae2c6cac/discovery/0.log" Jul 16 01:20:44.911215 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:44.911169 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-26s5d_151eeef3-6fce-4a97-b414-278fffdece35/payload-pre-processing/0.log" Jul 16 01:20:45.497776 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:45.497745 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zz8kb_669b6717-cabb-4ae9-8f0d-d5559cd4c036/main/0.log" Jul 16 01:20:45.839004 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:45.838933 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5s4mz_88bd1b07-2c8b-42a1-bec1-9a3a5338807c/main/0.log" Jul 16 01:20:54.786658 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:54.786626 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-szcgm_48358819-a2c3-4f11-a357-37146e084dc3/global-pull-secret-syncer/0.log" Jul 16 01:20:54.913326 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:54.913293 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xx95k_49a38a03-2af4-4d71-9291-8940c87c16bc/konnectivity-agent/0.log" Jul 16 01:20:54.932704 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:54.932681 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-73.ec2.internal_5b2e747f657eca90dcd990d916372685/haproxy/0.log" Jul 16 01:20:59.727442 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.727412 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb_c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9/extract/0.log" Jul 16 01:20:59.754054 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.754023 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb_c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9/util/0.log" Jul 16 01:20:59.781951 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.781924 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pglzb_c4511f56-5d6d-48bb-a0e9-42eb4aa66ff9/pull/0.log" Jul 16 01:20:59.818914 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.818889 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw_6ec844ee-2169-465a-9df7-c513e1c90a87/extract/0.log" Jul 16 01:20:59.844135 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.844104 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw_6ec844ee-2169-465a-9df7-c513e1c90a87/util/0.log" Jul 16 01:20:59.871757 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.871737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x6pfw_6ec844ee-2169-465a-9df7-c513e1c90a87/pull/0.log" Jul 16 01:20:59.904951 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.904931 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl_b4ada6c2-90b9-414d-9eb5-d6c87fa482dd/extract/0.log" Jul 16 01:20:59.934641 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.934620 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl_b4ada6c2-90b9-414d-9eb5-d6c87fa482dd/util/0.log" Jul 16 01:20:59.962922 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.962896 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732drbl_b4ada6c2-90b9-414d-9eb5-d6c87fa482dd/pull/0.log" Jul 16 01:20:59.992696 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:20:59.992632 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t_4f7e4188-1da6-41a0-8cb3-03fb573facf0/extract/0.log" Jul 16 01:21:00.023386 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:00.023358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t_4f7e4188-1da6-41a0-8cb3-03fb573facf0/util/0.log" Jul 16 01:21:00.051084 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:00.051060 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ljc8t_4f7e4188-1da6-41a0-8cb3-03fb573facf0/pull/0.log" Jul 16 01:21:00.929047 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:00.929007 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cbvcv_929f9487-93ca-4812-986f-dcfc47a94801/manager/0.log" Jul 16 01:21:02.904124 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:02.904076 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-j8k46_e41776ba-49e2-43eb-9493-ee5a1558ed34/kube-state-metrics/0.log" Jul 16 01:21:02.928219 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:02.928193 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-j8k46_e41776ba-49e2-43eb-9493-ee5a1558ed34/kube-rbac-proxy-main/0.log" Jul 16 01:21:02.952800 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:02.952772 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-j8k46_e41776ba-49e2-43eb-9493-ee5a1558ed34/kube-rbac-proxy-self/0.log" Jul 16 01:21:03.012470 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.012444 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-gwtnm_a64a386d-b37b-4656-bace-89ad54e7fb0a/monitoring-plugin/0.log" Jul 16 01:21:03.044717 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.044685 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4pdcb_9ecba924-650d-46f5-a5fd-a3903bd37214/node-exporter/0.log" Jul 16 01:21:03.067977 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.067956 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4pdcb_9ecba924-650d-46f5-a5fd-a3903bd37214/kube-rbac-proxy/0.log" Jul 16 01:21:03.089882 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.089861 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4pdcb_9ecba924-650d-46f5-a5fd-a3903bd37214/init-textfile/0.log" Jul 16 01:21:03.568355 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.568322 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-x6k9w_345bf62b-9d90-48a2-bbc6-2ed6fc40ba22/prometheus-operator/0.log" Jul 16 01:21:03.588857 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.588833 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-x6k9w_345bf62b-9d90-48a2-bbc6-2ed6fc40ba22/kube-rbac-proxy/0.log" Jul 16 01:21:03.614852 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.614827 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-fpq75_d02d143d-1a95-4623-8b65-6e7e5d2830a8/prometheus-operator-admission-webhook/0.log" Jul 16 01:21:03.656891 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.656863 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bd46f7c4-qw5gn_634bace5-bd2b-4fa4-8a1f-88fdac3903d8/telemeter-client/0.log" Jul 16 01:21:03.680371 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.680344 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bd46f7c4-qw5gn_634bace5-bd2b-4fa4-8a1f-88fdac3903d8/reload/0.log" Jul 16 01:21:03.704210 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:03.704167 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bd46f7c4-qw5gn_634bace5-bd2b-4fa4-8a1f-88fdac3903d8/kube-rbac-proxy/0.log" Jul 16 01:21:04.992578 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.992543 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx"] Jul 16 01:21:04.992949 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.992941 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eb6328-86c8-4134-9b55-43b972ef7308" containerName="cleanup" Jul 16 01:21:04.992991 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.992953 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eb6328-86c8-4134-9b55-43b972ef7308" containerName="cleanup" Jul 16 01:21:04.992991 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.992967 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08aa0ae8-70b3-4019-a004-02dd1e2a83ec" containerName="cleanup" Jul 16 01:21:04.992991 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.992973 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="08aa0ae8-70b3-4019-a004-02dd1e2a83ec" containerName="cleanup" Jul 16 01:21:04.992991 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.992990 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45c26bd-1998-49ce-ae55-0ecc42f506fc" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.992997 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45c26bd-1998-49ce-ae55-0ecc42f506fc" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993011 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c512be7-355d-424f-a74f-bc5ef319d5f7" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993018 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c512be7-355d-424f-a74f-bc5ef319d5f7" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993027 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105ddd74-e01b-4149-9f2c-ef07282e4678" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993032 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="105ddd74-e01b-4149-9f2c-ef07282e4678" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993038 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed259bbf-6875-4a40-9c9c-ac378369d142" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993043 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed259bbf-6875-4a40-9c9c-ac378369d142" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993050 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6411a95-86c4-4988-9fb9-4c42aff4ddf1" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993055 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6411a95-86c4-4988-9fb9-4c42aff4ddf1" containerName="cleanup" Jul 16 01:21:04.993116 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993117 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6411a95-86c4-4988-9fb9-4c42aff4ddf1" containerName="cleanup" Jul 16 01:21:04.993455 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993127 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c512be7-355d-424f-a74f-bc5ef319d5f7" containerName="cleanup" Jul 16 01:21:04.993455 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993134 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="105ddd74-e01b-4149-9f2c-ef07282e4678" containerName="cleanup" Jul 16 01:21:04.993455 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993143 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eb6328-86c8-4134-9b55-43b972ef7308" containerName="cleanup" Jul 16 01:21:04.993455 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993153 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="08aa0ae8-70b3-4019-a004-02dd1e2a83ec" containerName="cleanup" Jul 16 01:21:04.993455 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993160 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed259bbf-6875-4a40-9c9c-ac378369d142" containerName="cleanup" Jul 16 01:21:04.993455 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.993166 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45c26bd-1998-49ce-ae55-0ecc42f506fc" containerName="cleanup" Jul 16 01:21:04.996486 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.996461 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:04.998988 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.998967 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5b5g8\"/\"kube-root-ca.crt\"" Jul 16 01:21:04.999539 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.999516 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5b5g8\"/\"default-dockercfg-h42dq\"" Jul 16 01:21:04.999637 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:04.999516 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5b5g8\"/\"openshift-service-ca.crt\"" Jul 16 01:21:05.006091 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.006061 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx"] Jul 16 01:21:05.035351 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.035319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6dss\" (UniqueName: \"kubernetes.io/projected/b4fbf08d-f49e-4c45-8723-82b20e356e07-kube-api-access-k6dss\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.035488 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.035363 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-lib-modules\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.035488 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.035433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-podres\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.035561 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.035508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-proc\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.035600 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.035562 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-sys\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136743 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-podres\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136934 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-proc\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136934 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-sys\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136934 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6dss\" (UniqueName: \"kubernetes.io/projected/b4fbf08d-f49e-4c45-8723-82b20e356e07-kube-api-access-k6dss\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136934 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-lib-modules\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136934 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136868 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-podres\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136934 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136899 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-proc\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.136934 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136910 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-sys\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.137204 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.136969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4fbf08d-f49e-4c45-8723-82b20e356e07-lib-modules\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.145698 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.145678 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6dss\" (UniqueName: \"kubernetes.io/projected/b4fbf08d-f49e-4c45-8723-82b20e356e07-kube-api-access-k6dss\") pod \"perf-node-gather-daemonset-r4tdx\" (UID: \"b4fbf08d-f49e-4c45-8723-82b20e356e07\") " pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.307878 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.307788 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:05.439805 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:05.439774 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx"] Jul 16 01:21:05.441115 ip-10-0-141-73 kubenswrapper[2572]: W0716 01:21:05.441087 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb4fbf08d_f49e_4c45_8723_82b20e356e07.slice/crio-b30603061df497b5dc793797cac154358c5822f498467f5c32c471e762fcbe2e WatchSource:0}: Error finding container b30603061df497b5dc793797cac154358c5822f498467f5c32c471e762fcbe2e: Status 404 returned error can't find the container with id b30603061df497b5dc793797cac154358c5822f498467f5c32c471e762fcbe2e Jul 16 01:21:06.157139 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:06.157108 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64b876658d-hhslc_bae573ad-aea2-4138-8eac-1765ff66071e/console/0.log" Jul 16 01:21:06.190658 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:06.190632 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-629wb_09337c65-25e6-4f53-bced-c71b3b268363/download-server/0.log" Jul 16 01:21:06.192309 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:06.192283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" event={"ID":"b4fbf08d-f49e-4c45-8723-82b20e356e07","Type":"ContainerStarted","Data":"36490ac7ba9383ed1f3e8e35da0a7db636da7d47d677c93f95b7e8ffea38851b"} Jul 16 01:21:06.192424 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:06.192361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" event={"ID":"b4fbf08d-f49e-4c45-8723-82b20e356e07","Type":"ContainerStarted","Data":"b30603061df497b5dc793797cac154358c5822f498467f5c32c471e762fcbe2e"} Jul 16 01:21:06.192480 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:06.192467 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:06.208638 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:06.208598 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" podStartSLOduration=2.208583231 podStartE2EDuration="2.208583231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 01:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:21:06.207800844 +0000 UTC m=+2445.129849660" watchObservedRunningTime="2026-07-16 01:21:06.208583231 +0000 UTC m=+2445.130632045" Jul 16 01:21:07.930868 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:07.930837 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qf9rc_b680c65d-387e-4f06-b54d-72210ab9c223/dns/0.log" Jul 16 01:21:07.994131 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:07.994104 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qf9rc_b680c65d-387e-4f06-b54d-72210ab9c223/kube-rbac-proxy/0.log" Jul 16 01:21:08.165735 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:08.165708 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-crkgs_7d2bf0b8-da9c-428f-8d34-7026168c5f5b/dns-node-resolver/0.log" Jul 16 01:21:08.853350 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:08.853320 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zvdbq_c43adfa7-c983-4f34-93f8-961393b3da49/node-ca/0.log" Jul 16 01:21:09.908038 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:09.908009 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fqxs4_851a917f-7ecc-4739-a60f-23bcae2c6cac/discovery/0.log" Jul 16 01:21:10.079494 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:10.079469 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-26s5d_151eeef3-6fce-4a97-b414-278fffdece35/payload-pre-processing/0.log" Jul 16 01:21:10.828557 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:10.828527 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f5gkx_37c10581-0b88-4d20-b08b-0fbcd098d04f/serve-healthcheck-canary/0.log" Jul 16 01:21:11.465295 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:11.465261 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p76g8_ef9f9684-04b8-4c31-84f8-bf0a95746094/kube-rbac-proxy/0.log" Jul 16 01:21:11.489840 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:11.489814 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p76g8_ef9f9684-04b8-4c31-84f8-bf0a95746094/exporter/0.log" Jul 16 01:21:11.514949 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:11.514925 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p76g8_ef9f9684-04b8-4c31-84f8-bf0a95746094/extractor/0.log" Jul 16 01:21:12.208751 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:12.208724 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5b5g8/perf-node-gather-daemonset-r4tdx" Jul 16 01:21:14.192533 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:14.192503 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf8c55d45-2n5p8_62d4b692-f260-4c61-97cb-89fa4cfdc6fe/manager/0.log" Jul 16 01:21:14.218326 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:14.218301 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf8c55d45-2n5p8_62d4b692-f260-4c61-97cb-89fa4cfdc6fe/copy-manifests/0.log" Jul 16 01:21:15.798209 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:15.798165 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c857fdb5b-g4trq_862d1d1c-bb15-40ea-80bf-c0ee83215340/manager/0.log" Jul 16 01:21:16.120878 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:16.120841 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fqxs4_851a917f-7ecc-4739-a60f-23bcae2c6cac/discovery/0.log" Jul 16 01:21:16.265099 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:16.265068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-26s5d_151eeef3-6fce-4a97-b414-278fffdece35/payload-pre-processing/0.log" Jul 16 01:21:17.583664 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:17.583580 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fqxs4_851a917f-7ecc-4739-a60f-23bcae2c6cac/discovery/0.log" Jul 16 01:21:17.728354 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:17.728321 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-26s5d_151eeef3-6fce-4a97-b414-278fffdece35/payload-pre-processing/0.log" Jul 16 01:21:22.421345 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:22.421313 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwsl2_61f1d642-4155-4316-b07f-f3089a14e979/kube-multus-additional-cni-plugins/0.log" Jul 16 01:21:22.444933 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:22.444903 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwsl2_61f1d642-4155-4316-b07f-f3089a14e979/egress-router-binary-copy/0.log" Jul 16 01:21:22.469127 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:22.469102 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwsl2_61f1d642-4155-4316-b07f-f3089a14e979/cni-plugins/0.log" Jul 16 01:21:22.494384 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:22.494358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwsl2_61f1d642-4155-4316-b07f-f3089a14e979/bond-cni-plugin/0.log" Jul 16 01:21:22.519189 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:22.519165 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwsl2_61f1d642-4155-4316-b07f-f3089a14e979/routeoverride-cni/0.log" Jul 16 01:21:22.543068 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:22.543046 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwsl2_61f1d642-4155-4316-b07f-f3089a14e979/whereabouts-cni-bincopy/0.log" Jul 16 01:21:22.564475 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:22.564459 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwsl2_61f1d642-4155-4316-b07f-f3089a14e979/whereabouts-cni/0.log" Jul 16 01:21:23.025333 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:23.025303 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wnxjq_303ef4f7-7c29-4bbc-b847-9fea16cac6d8/kube-multus/0.log" Jul 16 01:21:23.149146 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:23.149120 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xs9zv_4aaeb25d-8cf9-49b3-8214-d742dfe94a72/network-metrics-daemon/0.log" Jul 16 01:21:23.170566 ip-10-0-141-73 kubenswrapper[2572]: I0716 01:21:23.170542 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xs9zv_4aaeb25d-8cf9-49b3-8214-d742dfe94a72/kube-rbac-proxy/0.log"