Sep 18 13:00:07.185168 ip-10-0-135-58 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 13:00:07.185178 ip-10-0-135-58 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 13:00:07.185185 ip-10-0-135-58 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 13:00:07.185350 ip-10-0-135-58 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 13:00:17.228161 ip-10-0-135-58 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 13:00:17.228181 ip-10-0-135-58 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f63dd8b763844761ac50affc0edf38a8 -- Sep 18 13:02:13.843719 ip-10-0-135-58 systemd[1]: Starting Kubernetes Kubelet... Sep 18 13:02:14.223940 ip-10-0-135-58 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:02:14.223940 ip-10-0-135-58 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 13:02:14.223940 ip-10-0-135-58 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:02:14.223940 ip-10-0-135-58 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 13:02:14.223940 ip-10-0-135-58 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 13:02:14.224836 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.224752 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 13:02:14.229747 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229727 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:02:14.229747 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229744 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:02:14.229747 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229748 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:02:14.229747 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229751 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:02:14.229747 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229753 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229756 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229761 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229766 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229769 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229772 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229775 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229778 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229780 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229783 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229786 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229788 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229791 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229794 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229797 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229799 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229802 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229805 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229807 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:02:14.229944 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229811 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229813 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229816 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229819 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229822 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229824 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229827 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229830 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229832 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229835 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229838 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229841 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229843 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229846 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229850 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229854 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229858 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229861 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229864 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229866 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:02:14.230393 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229869 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229873 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229875 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229878 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229881 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229883 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229886 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229889 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229892 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229896 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229899 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229903 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229906 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229909 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229912 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229915 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229918 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229920 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229923 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229926 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:02:14.230909 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229928 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229931 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229934 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229936 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229939 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229942 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229945 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229949 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229952 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229955 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229958 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229961 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229963 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229966 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229969 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229973 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229975 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229978 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229980 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229983 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:02:14.231383 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229986 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229989 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229992 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.229995 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230031 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230035 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230038 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230041 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230044 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230047 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230050 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230053 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230056 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230058 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230061 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230063 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230755 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230763 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230766 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:02:14.231884 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230769 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230774 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230778 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230782 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230785 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230788 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230791 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230794 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230797 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230800 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230803 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230806 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230808 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230811 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230814 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230817 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230819 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230822 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230824 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230827 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:02:14.232337 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230830 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230833 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230836 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230838 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230841 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230844 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230846 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230849 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230851 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230854 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230856 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230859 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230862 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230865 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230867 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230870 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230873 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230876 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230878 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230881 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:02:14.232849 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230884 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230887 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230889 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230892 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230895 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230898 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230900 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230903 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230906 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230908 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230911 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230915 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230919 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230922 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230925 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230928 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230930 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230933 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230936 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:02:14.233406 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230938 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230941 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230944 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230946 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230949 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230952 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230955 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230958 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230960 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230963 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230965 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230968 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230971 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230973 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230976 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230979 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230981 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230984 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230989 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:02:14.233977 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230992 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230995 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.230999 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231002 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231005 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231008 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231011 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231014 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231016 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231021 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231024 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231027 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231029 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231032 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231035 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231038 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231040 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231043 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231393 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231397 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:02:14.234494 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231401 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231404 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231406 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231409 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231412 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231414 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231417 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231420 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231422 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231425 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231428 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231430 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231448 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231453 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231457 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231459 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231462 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231465 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231468 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231471 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:02:14.235104 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231473 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231476 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231479 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231482 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231484 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231487 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231490 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231492 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231495 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231497 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231500 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231503 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231505 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231508 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231511 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231513 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231516 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231518 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231521 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231523 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:02:14.235609 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231526 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231535 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231538 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231541 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231543 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231546 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231548 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231552 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231554 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231557 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231560 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231563 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231566 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231568 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231571 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231574 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231577 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231579 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231584 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:02:14.236114 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231587 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231590 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231592 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231595 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231598 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231601 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231604 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231608 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231611 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231614 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231617 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231620 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231624 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231627 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231630 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231633 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231635 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231638 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231641 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:02:14.236608 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231644 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231646 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231650 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231652 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231655 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231657 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231660 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231662 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231665 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231668 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231670 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231673 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231676 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231678 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231681 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231683 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231686 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231688 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.231690 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231756 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231795 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 13:02:14.237093 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231802 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231806 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231810 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231814 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231818 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231822 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231825 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231828 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231832 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231837 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231841 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231843 2580 flags.go:64] FLAG: --cgroup-root="" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231847 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231850 2580 flags.go:64] FLAG: --client-ca-file="" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231853 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231857 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231861 2580 flags.go:64] FLAG: --cluster-domain="" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231864 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231867 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231870 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231873 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231877 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231880 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 13:02:14.237647 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231883 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231886 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231889 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231893 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231896 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231900 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231903 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231907 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231910 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231913 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231916 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231919 2580 flags.go:64] FLAG: --enable-server="true" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231922 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231926 2580 flags.go:64] FLAG: --event-burst="100" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231930 2580 flags.go:64] FLAG: --event-qps="50" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231932 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231935 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231938 2580 flags.go:64] FLAG: --eviction-hard="" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231943 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231946 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231949 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231955 2580 flags.go:64] FLAG: --eviction-soft="" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231958 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231961 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231965 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 13:02:14.238200 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231968 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231971 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231974 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231977 2580 flags.go:64] FLAG: --feature-gates="" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231981 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231984 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231987 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231990 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231993 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231996 2580 flags.go:64] FLAG: --help="false" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.231999 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232002 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232006 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232008 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232012 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232015 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232018 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232021 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232024 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232027 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232030 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232033 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232036 2580 flags.go:64] FLAG: --kube-reserved="" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232039 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 13:02:14.238874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232042 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232046 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232049 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232052 2580 flags.go:64] FLAG: --lock-file="" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232057 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232059 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232063 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232068 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232071 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232074 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232077 2580 flags.go:64] FLAG: --logging-format="text" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232080 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232083 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232086 2580 flags.go:64] FLAG: --manifest-url="" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232089 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232093 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232096 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232100 2580 flags.go:64] FLAG: --max-pods="110" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232103 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232106 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232109 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232112 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232115 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232118 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232121 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 13:02:14.239516 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232128 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232131 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232134 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232137 2580 flags.go:64] FLAG: --pod-cidr="" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232140 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232145 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232148 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232151 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232155 2580 flags.go:64] FLAG: --port="10250" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232158 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232161 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a52487279ef48b4" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232165 2580 flags.go:64] FLAG: --qos-reserved="" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232169 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232172 2580 flags.go:64] FLAG: --register-node="true" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232175 2580 flags.go:64] FLAG: --register-with-taints="" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232179 2580 flags.go:64] FLAG: --registry-burst="10" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232182 2580 flags.go:64] FLAG: --registry-qps="5" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232185 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232188 2580 flags.go:64] FLAG: --reserved-memory="" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232191 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232194 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232197 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232200 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232203 2580 flags.go:64] FLAG: --runonce="false" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232206 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 13:02:14.240127 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232209 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232212 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232215 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232218 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232221 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232224 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232227 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232230 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232233 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232236 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232238 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232241 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232245 2580 flags.go:64] FLAG: --system-cgroups="" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232247 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232252 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232256 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232259 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232263 2580 flags.go:64] FLAG: --tls-min-version="" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232266 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232270 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232273 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232276 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232279 2580 flags.go:64] FLAG: --v="2" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232283 2580 flags.go:64] FLAG: --version="false" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232287 2580 flags.go:64] FLAG: --vmodule="" Sep 18 13:02:14.240767 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232291 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.232294 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232398 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232402 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232405 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232408 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232410 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232413 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232415 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232418 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232421 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232423 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232426 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232429 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232432 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232453 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232458 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232461 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232464 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232467 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:02:14.241376 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232469 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232472 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232476 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232479 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232481 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232484 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232488 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232491 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232494 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232497 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232500 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232502 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232506 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232509 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232512 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232515 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232517 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232520 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232524 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232528 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:02:14.241907 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232531 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232534 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232537 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232539 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232542 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232545 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232547 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232550 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232553 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232555 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232558 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232561 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232563 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232566 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232600 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232604 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232607 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232610 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232614 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232618 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:02:14.242449 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232621 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232624 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232627 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232630 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232632 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232636 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232639 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232642 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232645 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232648 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232650 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232653 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232656 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232659 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232661 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232664 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232667 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232670 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232672 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232675 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:02:14.242940 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232677 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232680 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232683 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232685 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232688 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232692 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232697 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232700 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232703 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232706 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232710 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232713 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232715 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232718 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232721 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232724 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232726 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232729 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232733 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:02:14.243428 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232737 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.232741 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.234922 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.242677 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.242693 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.242712 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.242718 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242770 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242775 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242780 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242783 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242786 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242789 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242792 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242795 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:02:14.243981 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242798 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242801 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242803 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242806 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242809 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242812 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242815 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242818 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242821 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242824 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242827 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242830 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242832 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242835 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242838 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242840 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242843 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242846 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242850 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242854 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:02:14.244347 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242857 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242861 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242864 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242868 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242871 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242874 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242877 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242879 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242882 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242885 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242888 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242891 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242894 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242897 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242899 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242902 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242905 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242908 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242911 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242913 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:02:14.244848 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242916 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242919 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242921 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242924 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242928 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242932 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242935 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242938 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242941 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242945 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242948 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242951 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242954 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242957 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242960 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242963 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242966 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242969 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242971 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242974 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:02:14.245348 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242977 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242980 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242982 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242985 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242988 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242990 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242993 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242996 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.242998 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243001 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243004 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243006 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243009 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243012 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243015 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243018 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243020 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243024 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243028 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:02:14.245877 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243031 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243034 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243037 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243040 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243043 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243046 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243049 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243052 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243055 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243058 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243060 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243063 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.243068 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243175 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 13:02:14.246339 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243180 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243183 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243186 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243189 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243192 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243196 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243198 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243201 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243204 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243207 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243211 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243215 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243218 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243221 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243224 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243227 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243229 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243232 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243235 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 13:02:14.246716 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243237 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243240 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243243 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243246 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243249 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243252 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243254 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243257 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243261 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243264 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243266 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243269 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243272 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243274 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243277 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243280 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243282 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243285 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243288 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243290 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 13:02:14.247174 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243293 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243296 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243298 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243301 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243303 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243306 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243309 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243312 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243315 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243318 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243320 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243323 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243325 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243328 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243331 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243334 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243337 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243339 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243342 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243345 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243347 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 13:02:14.247674 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243350 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243354 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243357 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243360 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243363 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243366 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243369 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243372 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243374 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243377 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243379 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243382 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243385 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243387 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243390 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243393 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243395 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243399 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243403 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 13:02:14.248197 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243405 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243408 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243411 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243413 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243416 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243419 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243422 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243424 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243427 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243430 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243433 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243456 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243459 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243462 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243465 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243468 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243471 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243474 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 13:02:14.248739 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:14.243477 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 13:02:14.249305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.243482 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 13:02:14.249305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.243577 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 13:02:14.249305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.245736 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 13:02:14.249305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.246625 2580 server.go:1019] "Starting client certificate rotation" Sep 18 13:02:14.249305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.246720 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:02:14.249305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.246777 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 13:02:14.249305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.249099 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:02:14.252431 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.252409 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 13:02:14.261467 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.261450 2580 log.go:25] "Validated CRI v1 runtime API" Sep 18 13:02:14.262909 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.262898 2580 log.go:25] "Validated CRI v1 image API" Sep 18 13:02:14.263689 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.263675 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 13:02:14.267940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.267922 2580 fs.go:135] Filesystem UUIDs: map[2b499bbf-2f30-4d53-8316-d7fc166024c1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c0ee8fd0-6803-4dd1-aa35-4b82d5375968:/dev/nvme0n1p4] Sep 18 13:02:14.268007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.267940 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 13:02:14.272894 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.272791 2580 manager.go:216] Machine: {Timestamp:2026-09-18 13:02:14.271568129 +0000 UTC m=+0.318981906 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099366 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec246766addf10d6dacd13933437d6c3 SystemUUID:ec246766-addf-10d6-dacd-13933437d6c3 BootID:f63dd8b7-6384-4761-ac50-affc0edf38a8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e9:3b:0a:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e9:3b:0a:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:91:5c:14:68:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 13:02:14.272894 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.272889 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 13:02:14.272995 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.272963 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 13:02:14.276276 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.276249 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 13:02:14.276431 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.276280 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 13:02:14.277008 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.276998 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 13:02:14.277042 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.277010 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 13:02:14.277042 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.277018 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:02:14.277713 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.277703 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 13:02:14.278974 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.278963 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 13:02:14.282786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.282775 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:02:14.282898 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.282889 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 13:02:14.282927 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.282922 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 18 13:02:14.282953 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.282936 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 13:02:14.282953 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.282949 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 13:02:14.283011 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.282958 2580 kubelet.go:398] "Adding apiserver pod source" Sep 18 13:02:14.283011 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.282967 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 13:02:14.283301 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.283280 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:02:14.283301 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.283303 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 13:02:14.285578 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.285562 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 13:02:14.287688 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.287675 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 13:02:14.287742 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.287704 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 13:02:14.289337 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289326 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 13:02:14.289382 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289343 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 13:02:14.289382 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289350 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 13:02:14.289382 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289355 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 13:02:14.289382 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289364 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 13:02:14.289382 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289370 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 13:02:14.289382 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289382 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 13:02:14.289580 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289387 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 13:02:14.289580 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289394 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 13:02:14.289580 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289399 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 13:02:14.289580 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289408 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 13:02:14.289580 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.289414 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 13:02:14.290207 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.290198 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 13:02:14.290207 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.290207 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 13:02:14.293751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.293729 2580 server.go:1268] "Started kubelet" Sep 18 13:02:14.293859 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.293800 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 13:02:14.293994 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.293801 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 13:02:14.294060 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.294016 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 13:02:14.294515 ip-10-0-135-58 systemd[1]: Started Kubernetes Kubelet. Sep 18 13:02:14.297527 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.297503 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 13:02:14.299723 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.299702 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 18 13:02:14.301080 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.301058 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 13:02:14.301166 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.301104 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:02:14.301166 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.301156 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 13:02:14.301282 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.301257 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 13:02:14.301487 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.301336 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 13:02:14.305784 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.305767 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 13:02:14.306536 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.306520 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 13:02:14.306790 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.306678 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:14.307248 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307233 2580 factory.go:55] Registering systemd factory Sep 18 13:02:14.307248 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307250 2580 factory.go:223] Registration of the systemd container factory successfully Sep 18 13:02:14.307357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307233 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 13:02:14.307357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307234 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 13:02:14.307357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307309 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 13:02:14.307520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307376 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 18 13:02:14.307520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307386 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 18 13:02:14.307520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307463 2580 factory.go:153] Registering CRI-O factory Sep 18 13:02:14.307520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307473 2580 factory.go:223] Registration of the crio container factory successfully Sep 18 13:02:14.307520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307510 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 13:02:14.307520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307523 2580 factory.go:103] Registering Raw factory Sep 18 13:02:14.307731 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.307533 2580 manager.go:1196] Started watching for new ooms in manager Sep 18 13:02:14.308287 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.308274 2580 manager.go:349] Starting recovery of all containers Sep 18 13:02:14.312257 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.312227 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 13:02:14.312343 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.312279 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 13:02:14.313261 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.312419 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-58.ec2.internal.18d66be5401d71a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-58.ec2.internal,UID:ip-10-0-135-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-58.ec2.internal,},FirstTimestamp:2026-09-18 13:02:14.293705129 +0000 UTC m=+0.341118907,LastTimestamp:2026-09-18 13:02:14.293705129 +0000 UTC m=+0.341118907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-58.ec2.internal,}" Sep 18 13:02:14.318989 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.318847 2580 manager.go:354] Recovery completed Sep 18 13:02:14.320204 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.320188 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 18 13:02:14.323269 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.323255 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:02:14.327962 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.327945 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:02:14.328043 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.327978 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:02:14.328043 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.327994 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:02:14.328522 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.328508 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 13:02:14.328522 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.328520 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 13:02:14.328645 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.328537 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 18 13:02:14.328645 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.328561 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:02:14.330246 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.330235 2580 policy_none.go:49] "None policy: Start" Sep 18 13:02:14.330295 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.330249 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 13:02:14.330295 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.330259 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 13:02:14.331191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.331181 2580 policy_none.go:47] "Start" Sep 18 13:02:14.335139 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.335117 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:02:14.335220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.335153 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:02:14.335220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.335167 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:02:14.352046 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.351966 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-58.ec2.internal.18d66be542282c67 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-58.ec2.internal,UID:ip-10-0-135-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-58.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-58.ec2.internal,},FirstTimestamp:2026-09-18 13:02:14.327962727 +0000 UTC m=+0.375376507,LastTimestamp:2026-09-18 13:02:14.327962727 +0000 UTC m=+0.375376507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-58.ec2.internal,}" Sep 18 13:02:14.361399 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.361378 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5kpg" Sep 18 13:02:14.367052 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.366987 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-58.ec2.internal.18d66be542288440 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-58.ec2.internal,UID:ip-10-0-135-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-58.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-58.ec2.internal,},FirstTimestamp:2026-09-18 13:02:14.327985216 +0000 UTC m=+0.375398995,LastTimestamp:2026-09-18 13:02:14.327985216 +0000 UTC m=+0.375398995,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-58.ec2.internal,}" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.368164 2580 manager.go:337] "Starting Device Plugin manager" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.368200 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.368210 2580 server.go:87] "Starting device plugin registration server" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.368778 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.368789 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.368909 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.369007 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.369016 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.369532 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.369584 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.377125 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-58.ec2.internal.18d66be54228bcf4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-58.ec2.internal,UID:ip-10-0-135-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-58.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-58.ec2.internal,},FirstTimestamp:2026-09-18 13:02:14.327999732 +0000 UTC m=+0.375413511,LastTimestamp:2026-09-18 13:02:14.327999732 +0000 UTC m=+0.375413511,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-58.ec2.internal,}" Sep 18 13:02:14.383684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.381237 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5kpg" Sep 18 13:02:14.454480 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.454449 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 13:02:14.455663 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.455642 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 13:02:14.455769 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.455700 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 13:02:14.455769 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.455726 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 13:02:14.455860 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.455820 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 13:02:14.458218 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.458202 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:02:14.468998 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.468981 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:02:14.470102 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.470084 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:02:14.470189 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.470114 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:02:14.470189 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.470128 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:02:14.470189 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.470152 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.483423 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.483363 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.483423 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.483382 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-58.ec2.internal\": node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:14.511042 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.511025 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:14.556426 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.556404 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal"] Sep 18 13:02:14.556512 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.556477 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:02:14.557771 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.557758 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:02:14.557841 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.557784 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:02:14.557841 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.557799 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:02:14.559046 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559034 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:02:14.559204 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559192 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.559252 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559219 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:02:14.559823 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559806 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:02:14.559899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559831 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:02:14.559899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559844 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:02:14.559899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559862 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:02:14.559899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559879 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:02:14.559899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.559893 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:02:14.561490 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.561478 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.561536 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.561503 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 13:02:14.562832 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.562817 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientMemory" Sep 18 13:02:14.562907 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.562842 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 13:02:14.562907 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.562854 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeHasSufficientPID" Sep 18 13:02:14.588068 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.588053 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-58.ec2.internal\" not found" node="ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.592308 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.592295 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-58.ec2.internal\" not found" node="ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.609855 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.609836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45537bdadd91aa4ed68a329a28653edb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-58.ec2.internal\" (UID: \"45537bdadd91aa4ed68a329a28653edb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.609940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.609860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59e16b8038f1f7ea11fac01541b6e074-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal\" (UID: \"59e16b8038f1f7ea11fac01541b6e074\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.609940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.609878 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59e16b8038f1f7ea11fac01541b6e074-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal\" (UID: \"59e16b8038f1f7ea11fac01541b6e074\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.611938 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.611924 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:14.710632 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.710592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59e16b8038f1f7ea11fac01541b6e074-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal\" (UID: \"59e16b8038f1f7ea11fac01541b6e074\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.710632 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.710637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45537bdadd91aa4ed68a329a28653edb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-58.ec2.internal\" (UID: \"45537bdadd91aa4ed68a329a28653edb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.710784 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.710662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59e16b8038f1f7ea11fac01541b6e074-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal\" (UID: \"59e16b8038f1f7ea11fac01541b6e074\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.710784 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.710696 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59e16b8038f1f7ea11fac01541b6e074-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal\" (UID: \"59e16b8038f1f7ea11fac01541b6e074\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.710784 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.710697 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59e16b8038f1f7ea11fac01541b6e074-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal\" (UID: \"59e16b8038f1f7ea11fac01541b6e074\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.710784 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.710700 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45537bdadd91aa4ed68a329a28653edb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-58.ec2.internal\" (UID: \"45537bdadd91aa4ed68a329a28653edb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.712705 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.712689 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:14.813638 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.813609 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:14.891504 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.891463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.897232 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:14.897200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" Sep 18 13:02:14.913784 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:14.913752 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:16.924185 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:16.924166 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:17.024635 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:17.024566 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:17.124999 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:17.124970 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:17.156137 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.156117 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 13:02:17.156565 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.156248 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 13:02:17.225688 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:17.225657 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:17.292141 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.292046 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:02:17.295711 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.295673 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 12:57:16 +0000 UTC" deadline="2028-03-01 01:12:38.068063853 +0000 UTC" Sep 18 13:02:17.295711 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.295709 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12708h10m20.772358072s" Sep 18 13:02:17.326129 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:17.326098 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-58.ec2.internal\" not found" Sep 18 13:02:17.330284 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.330262 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:02:17.340676 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:17.340635 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e16b8038f1f7ea11fac01541b6e074.slice/crio-a31b361796b002f03bd1337ba730243dc9b8600e98c8727631e9edfdc5b0be87 WatchSource:0}: Error finding container a31b361796b002f03bd1337ba730243dc9b8600e98c8727631e9edfdc5b0be87: Status 404 returned error can't find the container with id a31b361796b002f03bd1337ba730243dc9b8600e98c8727631e9edfdc5b0be87 Sep 18 13:02:17.341059 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:17.341027 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45537bdadd91aa4ed68a329a28653edb.slice/crio-6574f26dcfd30535a257ae5fb7ab0066a6ac9e01f6dcafe566c36fdeeec6de40 WatchSource:0}: Error finding container 6574f26dcfd30535a257ae5fb7ab0066a6ac9e01f6dcafe566c36fdeeec6de40: Status 404 returned error can't find the container with id 6574f26dcfd30535a257ae5fb7ab0066a6ac9e01f6dcafe566c36fdeeec6de40 Sep 18 13:02:17.346150 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.346133 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:02:17.369318 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.369278 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" event={"ID":"45537bdadd91aa4ed68a329a28653edb","Type":"ContainerStarted","Data":"6574f26dcfd30535a257ae5fb7ab0066a6ac9e01f6dcafe566c36fdeeec6de40"} Sep 18 13:02:17.370222 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.370199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" event={"ID":"59e16b8038f1f7ea11fac01541b6e074","Type":"ContainerStarted","Data":"a31b361796b002f03bd1337ba730243dc9b8600e98c8727631e9edfdc5b0be87"} Sep 18 13:02:17.417426 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.417402 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" Sep 18 13:02:17.432850 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.432832 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:02:17.433851 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.433839 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" Sep 18 13:02:17.451261 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.451239 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 13:02:17.723342 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:17.723315 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:02:18.022475 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.022391 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 13:02:18.194281 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.194250 2580 apiserver.go:52] "Watching apiserver" Sep 18 13:02:18.202574 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.202547 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 13:02:18.205133 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.205105 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-sbtmh","openshift-cluster-node-tuning-operator/tuned-zfwlx","openshift-dns/node-resolver-d4hdl","openshift-image-registry/node-ca-4tsjm","openshift-multus/multus-7hfnw","openshift-multus/network-metrics-daemon-hwp4v","openshift-network-diagnostics/network-check-target-gl64v","openshift-network-operator/iptables-alerter-rdrcb","openshift-ovn-kubernetes/ovnkube-node-gtdt2","kube-system/global-pull-secret-syncer-xk4hx","kube-system/konnectivity-agent-trnv5","kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal"] Sep 18 13:02:18.207338 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.207315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:18.207447 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.207419 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:18.209021 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.208970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.210479 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.210460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.211545 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.211523 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hbkw6\"" Sep 18 13:02:18.211820 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.211805 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 13:02:18.211908 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.211839 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.213342 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.213321 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.213806 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.213790 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 13:02:18.214520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.214502 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 13:02:18.214669 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.214640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:18.214742 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.214719 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:18.216323 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.216304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.216433 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.216307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg2hd\"" Sep 18 13:02:18.216527 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.216514 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 13:02:18.218284 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.218266 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.219717 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.219699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.220848 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.220833 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 13:02:18.221340 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.221319 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.222338 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.222318 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 13:02:18.222338 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.222336 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 13:02:18.222684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.222667 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 13:02:18.222799 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.222781 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 13:02:18.222875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.222859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.224835 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.224437 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vz7dh\"" Sep 18 13:02:18.224835 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.224694 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 13:02:18.225459 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.225427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pntt7\"" Sep 18 13:02:18.225809 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.225684 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:02:18.227302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.225990 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 13:02:18.227302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.226177 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z8dgq\"" Sep 18 13:02:18.227302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.226216 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pqbnk\"" Sep 18 13:02:18.227302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.226314 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 13:02:18.227302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.225991 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 13:02:18.227302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.226878 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:02:18.227625 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.227308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 13:02:18.227672 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.227637 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 13:02:18.227753 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.227727 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 13:02:18.227882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.227867 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 13:02:18.228106 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.228084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.228208 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.228173 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:18.228272 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.228207 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 13:02:18.228326 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.228280 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 13:02:18.229016 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.228780 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 13:02:18.229016 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.228862 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 13:02:18.229215 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.229054 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 13:02:18.229215 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.229076 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x522l\"" Sep 18 13:02:18.229215 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.229103 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 13:02:18.229415 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.229398 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kgsqf\"" Sep 18 13:02:18.229639 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.229624 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 13:02:18.230070 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-hostroot\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.230152 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230076 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-etc-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.230152 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4acaf024-1e02-4de1-9906-e8ba4bc9b112-host\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.230152 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-ovn\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.230305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-node-log\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.230305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.230305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-netns\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.230305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-cni-bin\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.230305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovnkube-script-lib\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.230553 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.230553 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-conf-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.230553 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:18.230553 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230411 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp2gk\" (UniqueName: \"kubernetes.io/projected/4acaf024-1e02-4de1-9906-e8ba4bc9b112-kube-api-access-pp2gk\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfr24\" (UniqueName: \"kubernetes.io/projected/fa2fbfeb-7084-4c33-a604-24123f4420e9-kube-api-access-vfr24\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230814 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-system-cni-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-cni-netd\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovnkube-config\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.230988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6chr\" (UniqueName: \"kubernetes.io/projected/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-kube-api-access-j6chr\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4acaf024-1e02-4de1-9906-e8ba4bc9b112-serviceca\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-registration-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w48nd\" (UniqueName: \"kubernetes.io/projected/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-kube-api-access-w48nd\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-systemd\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-log-socket\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-cnibin\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-etc-kubernetes\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231257 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-systemd-units\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-slash\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231328 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-sys-fs\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-cni-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-socket-dir-parent\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27a05597-0b30-4d86-a40f-743c7965b10a-multus-daemon-config\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl7jr\" (UniqueName: \"kubernetes.io/projected/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-kube-api-access-bl7jr\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-device-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-k8s-cni-cncf-io\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-kubelet\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-multus-certs\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-kubelet\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-env-overrides\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.231993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-cni-multus\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231888 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-run-netns\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-var-lib-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovn-node-metrics-cert\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-socket-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.231992 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27a05597-0b30-4d86-a40f-743c7965b10a-cni-binary-copy\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-run-ovn-kubernetes\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87lsk\" (UniqueName: \"kubernetes.io/projected/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-kube-api-access-87lsk\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-system-cni-dir\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fgqb\" (UniqueName: \"kubernetes.io/projected/27a05597-0b30-4d86-a40f-743c7965b10a-kube-api-access-2fgqb\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-cni-bin\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-hosts-file\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-tmp-dir\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cnibin\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.232725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.232530 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 13:02:18.234432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.234413 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jq7wb\"" Sep 18 13:02:18.236265 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.236226 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 13:02:18.237941 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.237921 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 13:02:18.264905 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.264874 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnhtc" Sep 18 13:02:18.273909 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.273854 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnhtc" Sep 18 13:02:18.318554 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.318529 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 13:02:18.332985 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.332956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-host-slash\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.333107 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.333107 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-netns\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.333107 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-cni-bin\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.333107 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovnkube-script-lib\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.333302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333133 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-netns\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.333302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333151 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-cni-bin\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.333302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-dbus\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.333302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-modprobe-d\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.333500 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.333500 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysconfig\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.333584 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-run\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.333629 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1464bb5d-7f0f-4612-806c-20a44812b509-tmp\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.333680 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-conf-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.333730 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:18.333730 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-kubelet-config\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.333826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-conf-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.333826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c0c60e4-3608-4a1e-aca1-61ad7ebad995-agent-certs\") pod \"konnectivity-agent-trnv5\" (UID: \"2c0c60e4-3608-4a1e-aca1-61ad7ebad995\") " pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.333826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.333826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp2gk\" (UniqueName: \"kubernetes.io/projected/4acaf024-1e02-4de1-9906-e8ba4bc9b112-kube-api-access-pp2gk\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.333826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovnkube-script-lib\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.333826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfr24\" (UniqueName: \"kubernetes.io/projected/fa2fbfeb-7084-4c33-a604-24123f4420e9-kube-api-access-vfr24\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-host\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-system-cni-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333929 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cni-binary-copy\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-cni-netd\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.333978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-sys\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.333863 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovnkube-config\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-kubernetes\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.334097 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.334090 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:18.83405512 +0000 UTC m=+2.971529083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-cni-netd\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334111 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-system-cni-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6chr\" (UniqueName: \"kubernetes.io/projected/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-kube-api-access-j6chr\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4acaf024-1e02-4de1-9906-e8ba4bc9b112-serviceca\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-registration-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w48nd\" (UniqueName: \"kubernetes.io/projected/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-kube-api-access-w48nd\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-systemd\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-log-socket\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334315 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-registration-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-cnibin\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-systemd\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-etc-kubernetes\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-log-socket\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-systemd-units\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334469 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-etc-kubernetes\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.334714 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22j8t\" (UniqueName: \"kubernetes.io/projected/1464bb5d-7f0f-4612-806c-20a44812b509-kube-api-access-22j8t\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-cnibin\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-slash\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-systemd-units\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-sys-fs\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334571 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-slash\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovnkube-config\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334679 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-sys-fs\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-cni-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.334589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-cni-dir\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-socket-dir-parent\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27a05597-0b30-4d86-a40f-743c7965b10a-multus-daemon-config\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl7jr\" (UniqueName: \"kubernetes.io/projected/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-kube-api-access-bl7jr\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-device-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4acaf024-1e02-4de1-9906-e8ba4bc9b112-serviceca\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.335406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-k8s-cni-cncf-io\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-kubelet\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-multus-certs\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-multus-socket-dir-parent\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-kubelet\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-k8s-cni-cncf-io\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335473 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-kubelet\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335487 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-run-multus-certs\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335430 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-device-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335528 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-kubelet\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-env-overrides\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-cni-multus\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-run-netns\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-var-lib-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335708 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-host-var-lib-cni-multus\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-run-netns\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336104 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335808 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27a05597-0b30-4d86-a40f-743c7965b10a-multus-daemon-config\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovn-node-metrics-cert\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysctl-d\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335873 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-var-lib-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-lib-modules\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-socket-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-env-overrides\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.335985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27a05597-0b30-4d86-a40f-743c7965b10a-cni-binary-copy\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-run-ovn-kubernetes\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-socket-dir\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87lsk\" (UniqueName: \"kubernetes.io/projected/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-kube-api-access-87lsk\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-run-ovn-kubernetes\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336154 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysctl-conf\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d9b8\" (UniqueName: \"kubernetes.io/projected/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-kube-api-access-9d9b8\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-system-cni-dir\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.336844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fgqb\" (UniqueName: \"kubernetes.io/projected/27a05597-0b30-4d86-a40f-743c7965b10a-kube-api-access-2fgqb\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-cni-bin\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336500 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-system-cni-dir\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c0c60e4-3608-4a1e-aca1-61ad7ebad995-konnectivity-ca\") pod \"konnectivity-agent-trnv5\" (UID: \"2c0c60e4-3608-4a1e-aca1-61ad7ebad995\") " pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336581 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27a05597-0b30-4d86-a40f-743c7965b10a-cni-binary-copy\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-hosts-file\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-tmp-dir\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336753 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-host-cni-bin\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336859 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-hosts-file\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cnibin\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.336990 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-cnibin\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-hostroot\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337046 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-etc-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-systemd\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.337538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-etc-openvswitch\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-tmp-dir\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4acaf024-1e02-4de1-9906-e8ba4bc9b112-host\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27a05597-0b30-4d86-a40f-743c7965b10a-hostroot\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-ovn\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-node-log\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337203 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-run-ovn\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-var-lib-kubelet\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337248 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4acaf024-1e02-4de1-9906-e8ba4bc9b112-host\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1464bb5d-7f0f-4612-806c-20a44812b509-etc-tuned\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-node-log\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.338121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.337393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-iptables-alerter-script\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.340121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.340084 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-ovn-node-metrics-cert\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.349976 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.349957 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:18.349976 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.349979 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:18.350122 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.349991 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:18.350185 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.350147 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:18.85012908 +0000 UTC m=+2.987603041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:18.350355 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.350330 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfr24\" (UniqueName: \"kubernetes.io/projected/fa2fbfeb-7084-4c33-a604-24123f4420e9-kube-api-access-vfr24\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:18.350355 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.350335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl7jr\" (UniqueName: \"kubernetes.io/projected/cdec71bb-9c86-42bd-b2e8-0a83c1d221a2-kube-api-access-bl7jr\") pod \"multus-additional-cni-plugins-sbtmh\" (UID: \"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2\") " pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.350355 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.350345 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w48nd\" (UniqueName: \"kubernetes.io/projected/343adbb1-fc4f-4dd4-851d-fd4e563ffeec-kube-api-access-w48nd\") pod \"aws-ebs-csi-driver-node-vsfpp\" (UID: \"343adbb1-fc4f-4dd4-851d-fd4e563ffeec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.352515 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.352497 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp2gk\" (UniqueName: \"kubernetes.io/projected/4acaf024-1e02-4de1-9906-e8ba4bc9b112-kube-api-access-pp2gk\") pod \"node-ca-4tsjm\" (UID: \"4acaf024-1e02-4de1-9906-e8ba4bc9b112\") " pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.354861 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.354840 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6chr\" (UniqueName: \"kubernetes.io/projected/d9a9fbfa-749e-4750-8c3d-8c40386a7efb-kube-api-access-j6chr\") pod \"node-resolver-d4hdl\" (UID: \"d9a9fbfa-749e-4750-8c3d-8c40386a7efb\") " pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.360219 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.360201 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fgqb\" (UniqueName: \"kubernetes.io/projected/27a05597-0b30-4d86-a40f-743c7965b10a-kube-api-access-2fgqb\") pod \"multus-7hfnw\" (UID: \"27a05597-0b30-4d86-a40f-743c7965b10a\") " pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.360446 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.360431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87lsk\" (UniqueName: \"kubernetes.io/projected/fcf9db84-4ad1-480d-8fd7-c2e7e398a118-kube-api-access-87lsk\") pod \"ovnkube-node-gtdt2\" (UID: \"fcf9db84-4ad1-480d-8fd7-c2e7e398a118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.437734 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-sys\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.437923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-kubernetes\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.437923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22j8t\" (UniqueName: \"kubernetes.io/projected/1464bb5d-7f0f-4612-806c-20a44812b509-kube-api-access-22j8t\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.437923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437825 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-sys\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.437923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437839 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysctl-d\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.437923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-kubernetes\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.437923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-lib-modules\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.437923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysctl-conf\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d9b8\" (UniqueName: \"kubernetes.io/projected/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-kube-api-access-9d9b8\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-lib-modules\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysctl-d\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.437992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c0c60e4-3608-4a1e-aca1-61ad7ebad995-konnectivity-ca\") pod \"konnectivity-agent-trnv5\" (UID: \"2c0c60e4-3608-4a1e-aca1-61ad7ebad995\") " pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-systemd\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-var-lib-kubelet\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1464bb5d-7f0f-4612-806c-20a44812b509-etc-tuned\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438092 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysctl-conf\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-iptables-alerter-script\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438132 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-host-slash\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-dbus\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.438254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-modprobe-d\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438267 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-modprobe-d\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438270 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-host-slash\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.438308 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438326 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-dbus\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438337 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-var-lib-kubelet\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.438390 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:18.938352914 +0000 UTC m=+3.075826867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438403 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-systemd\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysconfig\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-run\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1464bb5d-7f0f-4612-806c-20a44812b509-tmp\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438564 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-run\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-kubelet-config\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438529 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-etc-sysconfig\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c0c60e4-3608-4a1e-aca1-61ad7ebad995-agent-certs\") pod \"konnectivity-agent-trnv5\" (UID: \"2c0c60e4-3608-4a1e-aca1-61ad7ebad995\") " pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-host\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438622 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-kubelet-config\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.438857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438616 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c0c60e4-3608-4a1e-aca1-61ad7ebad995-konnectivity-ca\") pod \"konnectivity-agent-trnv5\" (UID: \"2c0c60e4-3608-4a1e-aca1-61ad7ebad995\") " pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.439535 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438697 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-iptables-alerter-script\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.439535 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.438744 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1464bb5d-7f0f-4612-806c-20a44812b509-host\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.440759 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.440740 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1464bb5d-7f0f-4612-806c-20a44812b509-etc-tuned\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.440867 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.440811 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1464bb5d-7f0f-4612-806c-20a44812b509-tmp\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.441065 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.441047 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c0c60e4-3608-4a1e-aca1-61ad7ebad995-agent-certs\") pod \"konnectivity-agent-trnv5\" (UID: \"2c0c60e4-3608-4a1e-aca1-61ad7ebad995\") " pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.456060 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.456037 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d9b8\" (UniqueName: \"kubernetes.io/projected/93ad437b-a49e-4ceb-9d37-ef664a4bb90a-kube-api-access-9d9b8\") pod \"iptables-alerter-rdrcb\" (UID: \"93ad437b-a49e-4ceb-9d37-ef664a4bb90a\") " pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.461999 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.461980 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22j8t\" (UniqueName: \"kubernetes.io/projected/1464bb5d-7f0f-4612-806c-20a44812b509-kube-api-access-22j8t\") pod \"tuned-zfwlx\" (UID: \"1464bb5d-7f0f-4612-806c-20a44812b509\") " pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.519976 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.519948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" Sep 18 13:02:18.528797 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.528773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d4hdl" Sep 18 13:02:18.543097 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.543073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4tsjm" Sep 18 13:02:18.548480 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.548462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7hfnw" Sep 18 13:02:18.556593 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.556574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:18.564612 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.564593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" Sep 18 13:02:18.571348 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.571328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" Sep 18 13:02:18.579476 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.579452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rdrcb" Sep 18 13:02:18.585069 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.585047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:18.841673 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.841594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:18.841832 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.841771 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:18.841907 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.841833 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:19.84181857 +0000 UTC m=+3.979292515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:18.942888 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.942855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:18.943015 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:18.942907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:18.943049 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.943030 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:18.943091 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.943082 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:19.94306993 +0000 UTC m=+4.080543875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:18.943132 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.943034 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:18.943132 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.943125 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:18.943194 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.943138 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:18.943194 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:18.943181 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:19.943169535 +0000 UTC m=+4.080643493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:19.266142 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.266116 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a05597_0b30_4d86_a40f_743c7965b10a.slice/crio-99add613debf08331f61013fdfa2118d33afe5433c2081d8d7e48b9b7eb8208f WatchSource:0}: Error finding container 99add613debf08331f61013fdfa2118d33afe5433c2081d8d7e48b9b7eb8208f: Status 404 returned error can't find the container with id 99add613debf08331f61013fdfa2118d33afe5433c2081d8d7e48b9b7eb8208f Sep 18 13:02:19.269949 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.269884 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0c60e4_3608_4a1e_aca1_61ad7ebad995.slice/crio-59534f88e39fc423bc1cf63e015664d37221ea82959f9496d3f2b233f47b63e6 WatchSource:0}: Error finding container 59534f88e39fc423bc1cf63e015664d37221ea82959f9496d3f2b233f47b63e6: Status 404 returned error can't find the container with id 59534f88e39fc423bc1cf63e015664d37221ea82959f9496d3f2b233f47b63e6 Sep 18 13:02:19.272577 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.272551 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4acaf024_1e02_4de1_9906_e8ba4bc9b112.slice/crio-74a0787aa585e6ab53d32747b25bc77c64815c3caeca19a2955ee36e92e80b3c WatchSource:0}: Error finding container 74a0787aa585e6ab53d32747b25bc77c64815c3caeca19a2955ee36e92e80b3c: Status 404 returned error can't find the container with id 74a0787aa585e6ab53d32747b25bc77c64815c3caeca19a2955ee36e92e80b3c Sep 18 13:02:19.273260 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.273231 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a9fbfa_749e_4750_8c3d_8c40386a7efb.slice/crio-2b4718a1c442db1f39ccac04d40eb2ee3d98c000d574396a36f72b8ba70aabc3 WatchSource:0}: Error finding container 2b4718a1c442db1f39ccac04d40eb2ee3d98c000d574396a36f72b8ba70aabc3: Status 404 returned error can't find the container with id 2b4718a1c442db1f39ccac04d40eb2ee3d98c000d574396a36f72b8ba70aabc3 Sep 18 13:02:19.274693 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.274593 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ad437b_a49e_4ceb_9d37_ef664a4bb90a.slice/crio-f82bbfe893a2d55e4ec6f8fb7b543bceba27d83eeb6253c6b3213c270c993b10 WatchSource:0}: Error finding container f82bbfe893a2d55e4ec6f8fb7b543bceba27d83eeb6253c6b3213c270c993b10: Status 404 returned error can't find the container with id f82bbfe893a2d55e4ec6f8fb7b543bceba27d83eeb6253c6b3213c270c993b10 Sep 18 13:02:19.275651 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.275462 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdec71bb_9c86_42bd_b2e8_0a83c1d221a2.slice/crio-ec4d599d8e403147d2b3f45243173b70eec329dbc63bbec16cd2c8f5997445d2 WatchSource:0}: Error finding container ec4d599d8e403147d2b3f45243173b70eec329dbc63bbec16cd2c8f5997445d2: Status 404 returned error can't find the container with id ec4d599d8e403147d2b3f45243173b70eec329dbc63bbec16cd2c8f5997445d2 Sep 18 13:02:19.276421 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.276256 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf9db84_4ad1_480d_8fd7_c2e7e398a118.slice/crio-f6c9e19170a909580bf3718e56bb5a91ab1f6abdf14c15c5aa265e9e10bc7060 WatchSource:0}: Error finding container f6c9e19170a909580bf3718e56bb5a91ab1f6abdf14c15c5aa265e9e10bc7060: Status 404 returned error can't find the container with id f6c9e19170a909580bf3718e56bb5a91ab1f6abdf14c15c5aa265e9e10bc7060 Sep 18 13:02:19.277422 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.276834 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 12:57:18 +0000 UTC" deadline="2028-03-05 08:27:19.360282726 +0000 UTC" Sep 18 13:02:19.277422 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.276860 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12811h25m0.083426793s" Sep 18 13:02:19.277710 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.277606 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1464bb5d_7f0f_4612_806c_20a44812b509.slice/crio-5dc8350a26d63c42cff5ad26df4dc7b4e3c914c878d84f9190ce6073158897e0 WatchSource:0}: Error finding container 5dc8350a26d63c42cff5ad26df4dc7b4e3c914c878d84f9190ce6073158897e0: Status 404 returned error can't find the container with id 5dc8350a26d63c42cff5ad26df4dc7b4e3c914c878d84f9190ce6073158897e0 Sep 18 13:02:19.281890 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:02:19.278959 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343adbb1_fc4f_4dd4_851d_fd4e563ffeec.slice/crio-3cdc9f3a5df6f55084678d36815e0cb57005e566d6aaddb61df53ce6fed84ded WatchSource:0}: Error finding container 3cdc9f3a5df6f55084678d36815e0cb57005e566d6aaddb61df53ce6fed84ded: Status 404 returned error can't find the container with id 3cdc9f3a5df6f55084678d36815e0cb57005e566d6aaddb61df53ce6fed84ded Sep 18 13:02:19.366644 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.366614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:19.366729 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.366663 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:19.366779 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.366738 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:19.366855 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.366830 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:19.375436 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.375408 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerStarted","Data":"ec4d599d8e403147d2b3f45243173b70eec329dbc63bbec16cd2c8f5997445d2"} Sep 18 13:02:19.376658 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.376635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trnv5" event={"ID":"2c0c60e4-3608-4a1e-aca1-61ad7ebad995","Type":"ContainerStarted","Data":"59534f88e39fc423bc1cf63e015664d37221ea82959f9496d3f2b233f47b63e6"} Sep 18 13:02:19.377782 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.377764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" event={"ID":"1464bb5d-7f0f-4612-806c-20a44812b509","Type":"ContainerStarted","Data":"5dc8350a26d63c42cff5ad26df4dc7b4e3c914c878d84f9190ce6073158897e0"} Sep 18 13:02:19.378962 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.378944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"f6c9e19170a909580bf3718e56bb5a91ab1f6abdf14c15c5aa265e9e10bc7060"} Sep 18 13:02:19.379873 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.379847 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d4hdl" event={"ID":"d9a9fbfa-749e-4750-8c3d-8c40386a7efb","Type":"ContainerStarted","Data":"2b4718a1c442db1f39ccac04d40eb2ee3d98c000d574396a36f72b8ba70aabc3"} Sep 18 13:02:19.380824 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.380806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4tsjm" event={"ID":"4acaf024-1e02-4de1-9906-e8ba4bc9b112","Type":"ContainerStarted","Data":"74a0787aa585e6ab53d32747b25bc77c64815c3caeca19a2955ee36e92e80b3c"} Sep 18 13:02:19.381891 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.381873 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hfnw" event={"ID":"27a05597-0b30-4d86-a40f-743c7965b10a","Type":"ContainerStarted","Data":"99add613debf08331f61013fdfa2118d33afe5433c2081d8d7e48b9b7eb8208f"} Sep 18 13:02:19.383601 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.383579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" event={"ID":"45537bdadd91aa4ed68a329a28653edb","Type":"ContainerStarted","Data":"e8ba535b14a1fbb2d6852fc26fb245d12cd6a8d87dc725eecaf4df98b46434e0"} Sep 18 13:02:19.385328 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.385313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" event={"ID":"343adbb1-fc4f-4dd4-851d-fd4e563ffeec","Type":"ContainerStarted","Data":"3cdc9f3a5df6f55084678d36815e0cb57005e566d6aaddb61df53ce6fed84ded"} Sep 18 13:02:19.386333 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.386314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rdrcb" event={"ID":"93ad437b-a49e-4ceb-9d37-ef664a4bb90a","Type":"ContainerStarted","Data":"f82bbfe893a2d55e4ec6f8fb7b543bceba27d83eeb6253c6b3213c270c993b10"} Sep 18 13:02:19.850954 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.850874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:19.851111 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.851055 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:19.851179 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.851118 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:21.851098694 +0000 UTC m=+5.988572648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:19.952109 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.952067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:19.952273 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:19.952151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:19.952343 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.952298 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:19.952343 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.952322 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:19.952343 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.952334 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:19.952549 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.952408 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:21.952390081 +0000 UTC m=+6.089864040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:19.952816 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.952796 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:19.952884 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:19.952848 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:21.952833895 +0000 UTC m=+6.090307854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:20.277118 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:20.276971 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 12:57:18 +0000 UTC" deadline="2028-03-23 15:43:21.688770578 +0000 UTC" Sep 18 13:02:20.277118 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:20.277087 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13250h41m1.411687872s" Sep 18 13:02:20.369660 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:20.369176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:20.369660 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:20.369313 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:20.399530 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:20.398866 2580 generic.go:356] "Generic (PLEG): container finished" podID="59e16b8038f1f7ea11fac01541b6e074" containerID="a74847414d40fe43e03f727de54f7863c5c57b78163715719cd915be105500be" exitCode=0 Sep 18 13:02:20.399530 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:20.398968 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" event={"ID":"59e16b8038f1f7ea11fac01541b6e074","Type":"ContainerDied","Data":"a74847414d40fe43e03f727de54f7863c5c57b78163715719cd915be105500be"} Sep 18 13:02:20.419865 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:20.419814 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-58.ec2.internal" podStartSLOduration=3.41979428 podStartE2EDuration="3.41979428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:19.412920492 +0000 UTC m=+3.550394470" watchObservedRunningTime="2026-09-18 13:02:20.41979428 +0000 UTC m=+4.557268252" Sep 18 13:02:21.367218 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:21.366607 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:21.367218 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.366733 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:21.367218 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:21.367083 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:21.367218 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.367173 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:21.432316 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:21.432272 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" event={"ID":"59e16b8038f1f7ea11fac01541b6e074","Type":"ContainerStarted","Data":"6a0e51c85514385e0f1eefcd70bc3a2fd1351048c5722e031ad40527643c2024"} Sep 18 13:02:21.868223 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:21.868166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:21.868403 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.868328 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:21.868461 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.868413 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:25.868369546 +0000 UTC m=+10.005843492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:21.968839 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:21.968783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:21.969063 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:21.968860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:21.969063 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.969004 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:21.969063 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.969026 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:21.969063 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.969039 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:21.969266 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.969095 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:25.969076417 +0000 UTC m=+10.106550378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:21.969533 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.969516 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:21.969615 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:21.969570 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:25.969554527 +0000 UTC m=+10.107028474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:22.367005 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:22.366971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:22.367187 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:22.367116 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:23.366066 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:23.366033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:23.366523 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:23.366050 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:23.366523 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:23.366163 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:23.366523 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:23.366246 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:24.366531 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:24.366497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:24.366890 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:24.366651 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:25.366906 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:25.366714 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:25.366906 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:25.366749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:25.366906 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:25.366842 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:25.367520 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:25.366957 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:25.902827 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:25.902792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:25.903019 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:25.902940 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:25.903019 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:25.903000 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:33.902980692 +0000 UTC m=+18.040454656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:26.003448 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:26.003409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:26.003639 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:26.003501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:26.003707 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:26.003665 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:26.003707 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:26.003687 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:26.003707 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:26.003699 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:26.003898 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:26.003752 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:34.003734285 +0000 UTC m=+18.141208236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:26.004160 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:26.004141 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:26.004221 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:26.004198 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:34.004182187 +0000 UTC m=+18.141656138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:26.367579 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:26.367422 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:26.367579 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:26.367554 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:27.366784 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:27.366747 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:27.366956 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:27.366753 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:27.366956 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:27.366892 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:27.367089 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:27.366954 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:28.366499 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:28.366459 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:28.366950 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:28.366615 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:29.366138 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:29.366096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:29.366291 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:29.366139 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:29.366291 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:29.366221 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:29.366427 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:29.366328 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:30.366862 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:30.366831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:30.367289 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:30.366948 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:31.366155 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:31.366124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:31.366342 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:31.366125 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:31.366342 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:31.366239 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:31.366483 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:31.366339 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:32.366484 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:32.366453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:32.366883 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:32.366569 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:33.366367 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:33.366282 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:33.366367 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:33.366313 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:33.366954 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:33.366437 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:33.366954 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:33.366549 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:33.960213 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:33.960176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:33.960459 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:33.960328 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:33.960459 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:33.960405 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:49.960372882 +0000 UTC m=+34.097846845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:34.060891 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:34.060845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:34.061079 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:34.060919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:34.061079 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:34.060982 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:34.061079 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:34.061049 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:34.061079 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:34.061065 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:34.061079 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:34.061075 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:34.061334 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:34.061052 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:50.061036504 +0000 UTC m=+34.198510462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:34.061334 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:34.061126 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:02:50.061110775 +0000 UTC m=+34.198584722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:34.366476 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:34.366368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:34.366627 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:34.366539 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:35.366272 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:35.366239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:35.366484 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:35.366240 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:35.366484 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:35.366402 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:35.366484 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:35.366433 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:36.366446 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:36.366418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:36.366820 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:36.366510 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:37.366413 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.366247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:37.366559 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.366285 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:37.366559 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:37.366491 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:37.366968 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:37.366598 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:37.467016 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.466988 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" event={"ID":"1464bb5d-7f0f-4612-806c-20a44812b509","Type":"ContainerStarted","Data":"ce1151b9d0106285ae399f55b19c9ce8841cd0b728b8421a839ed9276989c56b"} Sep 18 13:02:37.469352 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.469332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:02:37.469721 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.469697 2580 generic.go:356] "Generic (PLEG): container finished" podID="fcf9db84-4ad1-480d-8fd7-c2e7e398a118" containerID="ad526d2e6fe7eb1aff86f7ac9b1158652145c87b016004bcfdccd87c3ada9037" exitCode=1 Sep 18 13:02:37.469786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.469767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"4fcd2d885b7093bed8473fa3acbfd474727795cbeea2b22362b08d24ee3042a9"} Sep 18 13:02:37.469845 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.469832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"e57164b52d103b0f5a8d74d425a9f141dd547dc043aee0b266ddf10be668800b"} Sep 18 13:02:37.469899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.469872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerDied","Data":"ad526d2e6fe7eb1aff86f7ac9b1158652145c87b016004bcfdccd87c3ada9037"} Sep 18 13:02:37.469953 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.469920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"8af79fff411149ac6872ce2c1e7d2202c7e75aef3d91c086152f7e4fe6dabe71"} Sep 18 13:02:37.471417 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.471328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d4hdl" event={"ID":"d9a9fbfa-749e-4750-8c3d-8c40386a7efb","Type":"ContainerStarted","Data":"d6f0924070083f493e1d7cf85de8bc51871ae5d6a3bde2442aa512a62c4ff80f"} Sep 18 13:02:37.472940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.472919 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4tsjm" event={"ID":"4acaf024-1e02-4de1-9906-e8ba4bc9b112","Type":"ContainerStarted","Data":"034886b968725430974405a8a3410ecbb44c2879814d9aeba208be8015e50287"} Sep 18 13:02:37.474633 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.474612 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hfnw" event={"ID":"27a05597-0b30-4d86-a40f-743c7965b10a","Type":"ContainerStarted","Data":"b13024ae95d2c80a2abd9cad43d469746c905c91961918c7d9211c099d7f1e31"} Sep 18 13:02:37.476001 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.475981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" event={"ID":"343adbb1-fc4f-4dd4-851d-fd4e563ffeec","Type":"ContainerStarted","Data":"e7cad040063ff33148420929d10ddb25299c0b6a4c6639b255d6451663614ad6"} Sep 18 13:02:37.477389 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.477357 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdec71bb-9c86-42bd-b2e8-0a83c1d221a2" containerID="f8798bec31c599851c300c6bf898aa587366bedfe7ee25b69546bd04f4e107f8" exitCode=0 Sep 18 13:02:37.477477 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.477400 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerDied","Data":"f8798bec31c599851c300c6bf898aa587366bedfe7ee25b69546bd04f4e107f8"} Sep 18 13:02:37.478778 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.478754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trnv5" event={"ID":"2c0c60e4-3608-4a1e-aca1-61ad7ebad995","Type":"ContainerStarted","Data":"3fd7dc222f3e89f4fdd92f84e6f490c0a06812d4e69cc032e0c158a47ab3decf"} Sep 18 13:02:37.494451 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.494411 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-58.ec2.internal" podStartSLOduration=20.494395026 podStartE2EDuration="20.494395026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:21.539836018 +0000 UTC m=+5.677309994" watchObservedRunningTime="2026-09-18 13:02:37.494395026 +0000 UTC m=+21.631868990" Sep 18 13:02:37.494557 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.494539 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zfwlx" podStartSLOduration=3.977497617 podStartE2EDuration="21.494533287s" totalImagesPullingTime="17.51703567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:37.494026912 +0000 UTC m=+21.631500878" watchObservedRunningTime="2026-09-18 13:02:37.494533287 +0000 UTC m=+21.632007254" Sep 18 13:02:37.577846 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.577794 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-trnv5" podStartSLOduration=7.914895917 podStartE2EDuration="21.577774003s" totalImagesPullingTime="13.662878086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:37.57766989 +0000 UTC m=+21.715143858" watchObservedRunningTime="2026-09-18 13:02:37.577774003 +0000 UTC m=+21.715247970" Sep 18 13:02:37.578190 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.578167 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7hfnw" podStartSLOduration=3.72597758 podStartE2EDuration="21.578159949s" totalImagesPullingTime="17.852182369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:37.552077919 +0000 UTC m=+21.689551886" watchObservedRunningTime="2026-09-18 13:02:37.578159949 +0000 UTC m=+21.715633920" Sep 18 13:02:37.615105 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:37.615053 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d4hdl" podStartSLOduration=7.955178648 podStartE2EDuration="21.615037987s" totalImagesPullingTime="13.659859339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:37.614425128 +0000 UTC m=+21.751899095" watchObservedRunningTime="2026-09-18 13:02:37.615037987 +0000 UTC m=+21.752511953" Sep 18 13:02:38.366264 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.366239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:38.366418 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:38.366347 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:38.406724 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.406702 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 13:02:38.485269 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.485243 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:02:38.485813 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.485776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"fac8e9fff5a74ebf6d3be91a8ba6fd442b7589c09416735e5a09dcbeb0d8a362"} Sep 18 13:02:38.485934 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.485868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"925ee6742770bcad83f4e6178cd9199438ee78acf31c7594087db58e8672745d"} Sep 18 13:02:38.487940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.487916 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" event={"ID":"343adbb1-fc4f-4dd4-851d-fd4e563ffeec","Type":"ContainerStarted","Data":"70f62a52acbc3b6adeb9d5648814723473e88a64b6a031885e7ec653d7433703"} Sep 18 13:02:38.489599 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.489540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rdrcb" event={"ID":"93ad437b-a49e-4ceb-9d37-ef664a4bb90a","Type":"ContainerStarted","Data":"8d9a7c2bf0b0b56c8245b46fc3d2084aa4954ab2d8a729cde7074912a694d0bd"} Sep 18 13:02:38.508432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:38.508368 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4tsjm" podStartSLOduration=4.984185236 podStartE2EDuration="22.508355239s" totalImagesPullingTime="17.524170003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:37.638156502 +0000 UTC m=+21.775630470" watchObservedRunningTime="2026-09-18 13:02:38.508355239 +0000 UTC m=+22.645829207" Sep 18 13:02:39.295233 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.295104 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:02:38.406719017Z","UUID":"e5dda311-8f88-4154-bb22-ca311482455e","Handler":null,"Name":"","Endpoint":""} Sep 18 13:02:39.296735 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.296710 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 13:02:39.296851 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.296746 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 13:02:39.366053 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.366022 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:39.366224 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:39.366146 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:39.366577 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.366548 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:39.366721 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:39.366651 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:39.653711 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.653608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:39.835782 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.835757 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:39.919906 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.919747 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:39.920391 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.920356 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:39.968913 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:39.968857 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rdrcb" podStartSLOduration=6.446347636 podStartE2EDuration="23.968836882s" totalImagesPullingTime="17.522489246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:38.508514792 +0000 UTC m=+22.645988759" watchObservedRunningTime="2026-09-18 13:02:39.968836882 +0000 UTC m=+24.106310852" Sep 18 13:02:40.065321 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.065292 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:40.165870 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.165835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:40.366286 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.366258 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:40.366436 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:40.366392 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:40.496326 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.496237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" event={"ID":"343adbb1-fc4f-4dd4-851d-fd4e563ffeec","Type":"ContainerStarted","Data":"34572d3dd9795679e97d5abb30ebafd6b5ea4ba485b994c156fd6523924705ba"} Sep 18 13:02:40.501368 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.501347 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:02:40.501795 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.501756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"23bc5b54c4992ec2b4446e4dc1e389b7f1b4b08d853e695078cf7bdac9f9676e"} Sep 18 13:02:40.519991 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.519952 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsfpp" podStartSLOduration=4.073017021 podStartE2EDuration="24.51993748s" totalImagesPullingTime="20.446920459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:40.519692168 +0000 UTC m=+24.657166136" watchObservedRunningTime="2026-09-18 13:02:40.51993748 +0000 UTC m=+24.657411445" Sep 18 13:02:40.738033 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:40.738001 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:41.144977 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:41.144928 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:41.158898 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:41.158870 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:41.159468 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:41.159448 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-trnv5" Sep 18 13:02:41.366604 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:41.366568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:41.366773 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:41.366575 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:41.366773 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:41.366679 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:41.366888 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:41.366796 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:41.544128 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:41.544093 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:41.953676 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:41.953646 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:42.338949 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:42.338813 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:42.365868 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:42.365842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:42.366009 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:42.365965 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:42.514055 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:42.514029 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:02:42.514510 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:42.514483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"28736c47b1689798c93dbef25916ebbbc01c5baa4ea8bc476408d8aced6801ca"} Sep 18 13:02:42.514858 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:42.514838 2580 scope.go:117] "RemoveContainer" containerID="ad526d2e6fe7eb1aff86f7ac9b1158652145c87b016004bcfdccd87c3ada9037" Sep 18 13:02:42.561957 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:42.561932 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:43.146148 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.146119 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:43.330026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.329998 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:43.366409 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.366366 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:43.366542 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:43.366478 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:43.366542 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.366533 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:43.366633 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:43.366616 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:43.518268 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.518238 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdec71bb-9c86-42bd-b2e8-0a83c1d221a2" containerID="a07d7cf9fcd5cbe87c86342040bdcb600d214567f553adb946e379e4b090ddcc" exitCode=0 Sep 18 13:02:43.518488 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.518328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerDied","Data":"a07d7cf9fcd5cbe87c86342040bdcb600d214567f553adb946e379e4b090ddcc"} Sep 18 13:02:43.522233 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.522215 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:02:43.522567 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.522547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" event={"ID":"fcf9db84-4ad1-480d-8fd7-c2e7e398a118","Type":"ContainerStarted","Data":"e40930659373751f7fd71ac4bdbb3280fc0679ba151e467da7fa3d41395df8b5"} Sep 18 13:02:43.522875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.522857 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:43.523007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.522905 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:43.523007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.522951 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:43.534470 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.534444 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:43.537829 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.537811 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:43.537931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.537921 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:02:43.636748 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.636720 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:43.955307 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:43.955280 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:44.345779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:44.344032 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:44.366718 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:44.366690 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:44.366836 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:44.366789 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:44.446360 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:44.446318 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:44.744044 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:44.744021 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:45.163675 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.163593 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:45.366845 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.366810 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:45.367365 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.366816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:45.367365 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:45.366919 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:45.367365 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:45.367006 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:45.387513 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.387486 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:45.528757 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.528729 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdec71bb-9c86-42bd-b2e8-0a83c1d221a2" containerID="ea293b118398c03456549aec1020d9652ba4b2b1db05da45582f57725ada9bd7" exitCode=0 Sep 18 13:02:45.528884 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.528798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerDied","Data":"ea293b118398c03456549aec1020d9652ba4b2b1db05da45582f57725ada9bd7"} Sep 18 13:02:45.564389 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.564339 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" podStartSLOduration=12.009024671 podStartE2EDuration="29.564325489s" totalImagesPullingTime="17.555300818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:43.592675874 +0000 UTC m=+27.730149839" watchObservedRunningTime="2026-09-18 13:02:45.564325489 +0000 UTC m=+29.701799455" Sep 18 13:02:45.926773 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:45.926699 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:46.216244 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:46.216211 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:46.367521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:46.367491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:46.368015 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:46.367620 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:46.395085 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:46.395056 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:46.533037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:46.533011 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerStarted","Data":"f09d2318ab610efcf10edf8bf88d5a700791472908715256c890faf07ca0e528"} Sep 18 13:02:46.755494 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:46.755416 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:47.198367 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:47.198335 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:47.366741 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:47.366706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:47.366980 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:47.366810 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:47.366980 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:47.366863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:47.366980 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:47.366952 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:47.538243 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:47.538165 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdec71bb-9c86-42bd-b2e8-0a83c1d221a2" containerID="f09d2318ab610efcf10edf8bf88d5a700791472908715256c890faf07ca0e528" exitCode=0 Sep 18 13:02:47.538243 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:47.538200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerDied","Data":"f09d2318ab610efcf10edf8bf88d5a700791472908715256c890faf07ca0e528"} Sep 18 13:02:47.606366 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:47.606332 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:47.738356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:47.738329 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:48.189547 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:48.189516 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:48.365983 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:48.365954 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:48.366159 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:48.366078 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:48.766639 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:48.766607 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:49.234471 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:49.234441 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:49.366091 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:49.366055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:49.366255 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:49.366097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:49.366255 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:49.366165 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:49.366356 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:49.366314 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:49.556283 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:49.556213 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:49.967118 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:49.967067 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:49.979136 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:49.979107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:49.979280 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:49.979260 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:49.979341 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:49.979328 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:03:21.979312628 +0000 UTC m=+66.116786576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:02:50.080250 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:50.080210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:50.080436 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:50.080398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:50.080436 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:50.080421 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:02:50.080550 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:50.080445 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:02:50.080550 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:50.080462 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:50.080550 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:50.080513 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:50.080550 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:50.080531 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:03:22.080505595 +0000 UTC m=+66.217979558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:02:50.080703 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:50.080573 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:03:22.080557516 +0000 UTC m=+66.218031466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:02:50.154418 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:50.154361 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:50.366354 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:50.366281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:50.366521 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:50.366423 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:50.373881 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:50.373851 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:51.156432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:51.156397 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:51.304188 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:51.304161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:51.366082 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:51.366054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:51.366247 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:51.366059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:51.366247 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:51.366171 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:51.366348 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:51.366265 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:52.366921 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:52.366898 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:52.367178 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:52.367023 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:52.552831 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:52.552756 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdec71bb-9c86-42bd-b2e8-0a83c1d221a2" containerID="c5216da7e88572155695a95a0f69364df7e832f429612fe7b4def961a0a89aea" exitCode=0 Sep 18 13:02:52.552831 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:52.552799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerDied","Data":"c5216da7e88572155695a95a0f69364df7e832f429612fe7b4def961a0a89aea"} Sep 18 13:02:53.168187 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.168148 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:53.273640 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.273599 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:53.366667 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.366636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:53.366667 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.366668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:53.366849 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:53.366760 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:53.366901 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:53.366874 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:53.490826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.490798 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:53.558101 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.558073 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdec71bb-9c86-42bd-b2e8-0a83c1d221a2" containerID="0bcebb94eca6bdfe22405ad226cd61d58f66324dd2c33f2fcd31024cdb6a63bc" exitCode=0 Sep 18 13:02:53.558101 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.558111 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerDied","Data":"0bcebb94eca6bdfe22405ad226cd61d58f66324dd2c33f2fcd31024cdb6a63bc"} Sep 18 13:02:53.619508 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.619476 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:53.722787 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.722610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:53.891969 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:53.891893 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:54.366679 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:54.366647 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:54.366826 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:54.366760 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:54.563878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:54.563844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" event={"ID":"cdec71bb-9c86-42bd-b2e8-0a83c1d221a2","Type":"ContainerStarted","Data":"98456fccb583f9162c84f226c071d5789173cf3cacdf52bb4ad29309cbf32e03"} Sep 18 13:02:54.602600 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:54.602549 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sbtmh" podStartSLOduration=9.43564658 podStartE2EDuration="38.602534682s" totalImagesPullingTime="29.166888102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:02:54.600995752 +0000 UTC m=+38.738469729" watchObservedRunningTime="2026-09-18 13:02:54.602534682 +0000 UTC m=+38.740008648" Sep 18 13:02:55.037350 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:55.037320 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:55.223814 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:55.223785 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:55.366213 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:55.366136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:55.366370 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:55.366136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:55.366370 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:55.366235 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:55.366370 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:55.366330 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:55.537452 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:55.537422 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:56.366954 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:56.366922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:56.367317 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:56.367016 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:57.366794 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:57.366762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:57.366942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:57.366762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:57.366942 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:57.366865 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:02:57.366942 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:57.366926 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:58.122319 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:58.122290 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:58.225393 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:58.225352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:58.321204 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:58.321172 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:58.366779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:58.366754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:02:58.366927 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:58.366859 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:02:58.452285 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:58.452258 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:02:59.366271 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:59.366241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:02:59.366541 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:02:59.366241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:02:59.366541 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:59.366345 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:02:59.366541 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:02:59.366434 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:00.366506 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:00.366475 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:00.366878 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:00.366591 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:01.366065 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:01.366027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:01.366231 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:01.366072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:01.366231 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:01.366136 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:01.366310 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:01.366235 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:01.805824 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:01.805788 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:02.011098 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:02.011062 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:02.366712 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:02.366680 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:02.366876 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:02.366806 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:03.366791 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:03.366757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:03.367166 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:03.366757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:03.367166 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:03.366857 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:03.367166 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:03.366931 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:04.366417 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:04.366361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:04.366590 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:04.366505 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:05.366835 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:05.366804 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:05.367208 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:05.366804 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:05.367208 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:05.366897 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:05.367208 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:05.366966 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:06.216522 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:06.216490 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:06.367313 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:06.367279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:06.367742 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:06.367408 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:06.406903 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:06.406870 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:07.366541 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:07.366478 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:07.366541 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:07.366535 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:07.366742 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:07.366607 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:07.366742 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:07.366708 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:08.366871 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:08.366837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:08.367283 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:08.366973 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:09.366247 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:09.366213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:09.366458 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:09.366215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:09.366458 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:09.366303 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:09.366458 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:09.366419 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:10.366795 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:10.366765 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:10.367223 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:10.366868 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:11.366894 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:11.366861 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:11.367252 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:11.366960 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:11.367252 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:11.367014 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:11.367252 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:11.367089 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:12.366023 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:12.365993 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:12.366209 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:12.366116 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:13.365975 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:13.365940 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:13.366347 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:13.365940 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:13.366347 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:13.366080 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:13.366347 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:13.366109 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:14.366392 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:14.366339 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:14.366846 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:14.366521 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:15.366297 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:15.366270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:15.366539 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:15.366270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:15.366539 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:15.366369 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:15.366539 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:15.366481 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:15.539299 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:15.539261 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" podUID="fcf9db84-4ad1-480d-8fd7-c2e7e398a118" containerName="ovnkube-controller" probeResult="failure" output="" Sep 18 13:03:16.366966 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:16.366932 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:16.367344 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:16.367056 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:17.366301 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:17.366272 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:17.366474 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:17.366273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:17.366474 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:17.366363 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:17.366558 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:17.366495 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:18.366546 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:18.366518 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:18.366966 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:18.366640 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:19.366851 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:19.366824 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:19.367211 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:19.366824 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:19.367211 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:19.366948 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:19.367211 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:19.366976 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:20.366423 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:20.366372 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:20.366613 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:20.366493 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:21.118600 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:21.118569 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:21.217683 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:21.217653 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:21.366001 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:21.365973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:21.366193 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:21.365972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:21.366193 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:21.366094 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:21.366193 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:21.366138 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:22.005078 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.005047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:22.005263 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.005171 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:03:22.005263 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.005231 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:04:26.005213918 +0000 UTC m=+130.142687863 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:03:22.106205 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.106177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:22.106328 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.106219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:22.106328 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.106303 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:03:22.106328 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.106320 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:03:22.106449 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.106336 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:03:22.106449 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.106346 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:03:22.106449 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.106350 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:04:26.106336921 +0000 UTC m=+130.243810866 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:03:22.106449 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.106395 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:04:26.106371556 +0000 UTC m=+130.243845516 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:03:22.366357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.366283 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:22.366752 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:22.366414 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:22.630434 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.630355 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/0.log" Sep 18 13:03:22.630434 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.630404 2580 generic.go:356] "Generic (PLEG): container finished" podID="27a05597-0b30-4d86-a40f-743c7965b10a" containerID="b13024ae95d2c80a2abd9cad43d469746c905c91961918c7d9211c099d7f1e31" exitCode=1 Sep 18 13:03:22.630588 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.630446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hfnw" event={"ID":"27a05597-0b30-4d86-a40f-743c7965b10a","Type":"ContainerDied","Data":"b13024ae95d2c80a2abd9cad43d469746c905c91961918c7d9211c099d7f1e31"} Sep 18 13:03:22.630804 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:22.630792 2580 scope.go:117] "RemoveContainer" containerID="b13024ae95d2c80a2abd9cad43d469746c905c91961918c7d9211c099d7f1e31" Sep 18 13:03:23.366570 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:23.366538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:23.366989 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:23.366578 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:23.366989 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:23.366628 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:23.366989 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:23.366673 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:23.634538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:23.634460 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/0.log" Sep 18 13:03:23.634701 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:23.634543 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hfnw" event={"ID":"27a05597-0b30-4d86-a40f-743c7965b10a","Type":"ContainerStarted","Data":"7c33d80d1925d5992e2282c80528bb193ea293ab823b9ab8e5882b2da5f7e8b0"} Sep 18 13:03:24.366569 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:24.366538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:24.366738 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:24.366636 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:25.366805 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:25.366774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:25.367246 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:25.366784 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:25.367246 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:25.366859 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:25.367246 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:25.366961 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:26.366751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:26.366720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:26.366905 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:26.366803 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:27.366583 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:27.366545 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:27.366862 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:27.366545 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:27.366862 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:27.366664 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:27.366862 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:27.366711 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:28.366422 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:28.366391 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:28.366585 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:28.366491 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:29.366002 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:29.365964 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:29.366486 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:29.365965 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:29.366486 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:29.366090 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:29.366486 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:29.366137 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:30.366287 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:30.366254 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:30.366780 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:30.366354 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:31.366291 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:31.366260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:31.366755 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:31.366364 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:31.366755 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:31.366425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:31.366755 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:31.366530 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:32.366110 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:32.366082 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:32.366312 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:32.366179 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:33.365859 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:33.365829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:33.366025 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:33.365868 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:33.366025 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:33.365935 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:33.366100 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:33.366051 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:34.366609 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:34.366568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:34.367018 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:34.366680 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:35.366789 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:35.366752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:35.367178 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:35.366753 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:35.367178 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:35.366944 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:35.367178 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:35.366858 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:36.367278 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:36.367241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:36.367653 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:36.367332 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:37.365847 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:37.365808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:37.365847 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:37.365808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:37.366068 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:37.366052 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:37.366163 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:37.366146 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:38.366754 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:38.366721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:38.367200 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:38.366836 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:39.365917 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:39.365812 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:39.365917 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:39.365899 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:39.366107 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:39.365953 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:39.366107 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:39.366030 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:40.366451 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:40.366418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:40.366811 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:40.366540 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:41.366262 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:41.366219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:41.366521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:41.366219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:41.366521 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:41.366323 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:41.366521 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:41.366413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:42.366334 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:42.366305 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:42.366510 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:42.366430 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:43.366488 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:43.366452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:43.366882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:43.366452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:43.366882 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:43.366557 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:43.366882 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:43.366619 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:44.365924 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:44.365894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:44.366091 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:44.366003 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:45.366406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:45.366367 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:45.366783 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:45.366367 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:45.366783 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:45.366561 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:45.366783 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:45.366485 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:45.538829 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:45.538792 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" podUID="fcf9db84-4ad1-480d-8fd7-c2e7e398a118" containerName="ovnkube-controller" probeResult="failure" output="" Sep 18 13:03:46.367986 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:46.367948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:46.368363 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:46.368078 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:47.366195 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:47.366163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:47.366369 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:47.366171 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:47.366369 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:47.366255 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:47.366369 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:47.366338 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:48.365982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:48.365947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:48.366367 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:48.366175 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:49.365942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:49.365907 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:49.366147 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:49.365918 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:49.366147 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:49.366029 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:49.366147 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:49.366062 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:50.366114 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:50.366082 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:50.366285 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:50.366186 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:51.366611 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:51.366565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:51.366994 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:51.366566 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:51.366994 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:51.366669 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:51.366994 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:51.366744 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:52.366069 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:52.366036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:52.366254 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:52.366160 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:52.656745 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:52.656669 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:53.366145 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:53.366115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:53.366333 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:53.366219 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:53.366333 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:53.366287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:53.366488 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:53.366360 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:54.366604 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:54.366573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:54.366978 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:54.366675 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:55.366799 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:55.366762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:55.367249 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:55.366865 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:55.367249 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:55.366870 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:55.367249 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:55.366996 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:56.367673 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:56.367646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:56.368121 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:56.367754 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:57.366232 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:57.366199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:57.366457 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:57.366199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:57.366457 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:57.366314 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:57.366457 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:57.366424 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:57.820227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:57.820198 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:03:58.366539 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:58.366513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:03:58.366717 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:58.366632 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:03:58.983989 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:58.983960 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d4hdl_d9a9fbfa-749e-4750-8c3d-8c40386a7efb/dns-node-resolver/0.log" Sep 18 13:03:59.366868 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:59.366776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:03:59.366868 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:59.366815 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:03:59.367051 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:59.366885 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:03:59.367424 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:03:59.367396 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:03:59.375777 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:59.375748 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" podUID="fcf9db84-4ad1-480d-8fd7-c2e7e398a118" containerName="ovnkube-controller" probeResult="failure" output="" Sep 18 13:03:59.985931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:03:59.985901 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4tsjm_4acaf024-1e02-4de1-9906-e8ba4bc9b112/node-ca/0.log" Sep 18 13:04:00.366837 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:00.366754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:00.366977 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:00.366857 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:01.366822 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:01.366795 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:01.367261 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:01.366882 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:01.367261 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:01.366979 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:01.367261 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:01.367034 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:01.715390 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:01.715358 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:01.816594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:01.816557 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:02.366121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:02.366085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:02.366286 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:02.366229 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:03.366359 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:03.366324 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:03.366751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:03.366324 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:03.366751 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:03.366466 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:03.366751 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:03.366500 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:04.366370 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:04.366193 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:04.366780 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:04.366473 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:05.366826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:05.366784 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:05.367297 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:05.366785 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:05.367297 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:05.366990 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:05.367297 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:05.366883 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:06.367217 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:06.367180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:06.367609 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:06.367282 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:07.366137 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:07.366102 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:07.366335 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:07.366103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:07.366335 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:07.366222 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:07.366335 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:07.366265 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:08.366586 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:08.366486 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:08.367031 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:08.366601 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:08.732327 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:08.732302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:04:08.732716 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:08.732701 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/0.log" Sep 18 13:04:08.732814 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:08.732737 2580 generic.go:356] "Generic (PLEG): container finished" podID="27a05597-0b30-4d86-a40f-743c7965b10a" containerID="7c33d80d1925d5992e2282c80528bb193ea293ab823b9ab8e5882b2da5f7e8b0" exitCode=1 Sep 18 13:04:08.732814 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:08.732786 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hfnw" event={"ID":"27a05597-0b30-4d86-a40f-743c7965b10a","Type":"ContainerDied","Data":"7c33d80d1925d5992e2282c80528bb193ea293ab823b9ab8e5882b2da5f7e8b0"} Sep 18 13:04:08.732933 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:08.732858 2580 scope.go:117] "RemoveContainer" containerID="b13024ae95d2c80a2abd9cad43d469746c905c91961918c7d9211c099d7f1e31" Sep 18 13:04:08.733176 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:08.733154 2580 scope.go:117] "RemoveContainer" containerID="7c33d80d1925d5992e2282c80528bb193ea293ab823b9ab8e5882b2da5f7e8b0" Sep 18 13:04:08.733351 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:08.733325 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-multus pod=multus-7hfnw_openshift-multus(27a05597-0b30-4d86-a40f-743c7965b10a)\"" pod="openshift-multus/multus-7hfnw" podUID="27a05597-0b30-4d86-a40f-743c7965b10a" Sep 18 13:04:09.366799 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:09.366762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:09.367261 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:09.366864 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:09.367261 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:09.366921 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:09.367261 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:09.367004 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:09.736425 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:09.736396 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:04:10.125345 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:10.125259 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:10.366674 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:10.366642 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:10.366872 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:10.366755 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:10.393332 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:10.393254 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:10.630488 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:10.630459 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:10.873055 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:10.873021 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:11.136482 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.136394 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:11.366103 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.366063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:11.366103 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.366083 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:11.366460 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:11.366187 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:11.366460 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:11.366289 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:11.431785 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.431755 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xk4hx"] Sep 18 13:04:11.439551 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.439524 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hwp4v"] Sep 18 13:04:11.439685 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.439650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:11.439785 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:11.439764 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:11.440170 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.440145 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gl64v"] Sep 18 13:04:11.741241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.741172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:11.741406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:11.741172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:11.741406 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:11.741266 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:11.741406 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:11.741333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:13.366809 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:13.366775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:13.367179 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:13.366875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:13.367179 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:13.366882 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:13.367179 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:13.366957 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:13.367179 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:13.366878 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:13.367179 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:13.367024 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:14.347829 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:14.347654 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:14.455528 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:14.455497 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:15.062782 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:15.062754 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:15.366156 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:15.366071 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:15.366156 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:15.366101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:15.366156 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:15.366117 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:15.366347 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:15.366205 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:15.366401 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:15.366340 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:15.366401 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:15.366369 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:16.217729 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:16.217702 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:16.280434 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:16.280404 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:16.289576 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:16.289560 2580 kubelet_node_status.go:448] "Node not becoming ready in time after startup" Sep 18 13:04:16.296650 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:16.296622 2580 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Sep 18 13:04:17.251451 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:17.251416 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:17.366101 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:17.366059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:17.366244 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:17.366059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:17.366244 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:17.366170 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:17.366339 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:17.366066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:17.366339 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:17.366252 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:17.366339 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:17.366331 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:18.505281 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.505248 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:18.749973 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.749946 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:18.821808 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.821727 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f2n4x"] Sep 18 13:04:18.823674 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.823658 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.826940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.826915 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 13:04:18.827061 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.827006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 13:04:18.827221 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.827206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 13:04:18.827270 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.827245 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 13:04:18.827998 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.827982 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wlt4p\"" Sep 18 13:04:18.828054 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.828009 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 13:04:18.828323 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.828310 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 13:04:18.862004 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.861984 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:18.903404 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-sys\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903514 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-wtmp\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903514 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903582 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-tls\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903582 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-metrics-client-ca\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903582 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903671 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cmgj\" (UniqueName: \"kubernetes.io/projected/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-kube-api-access-9cmgj\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903671 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-textfile\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.903671 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.903658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-root\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:18.970432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:18.970406 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:19.004630 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-textfile\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004739 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-root\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004739 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-sys\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004739 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-wtmp\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-tls\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004790 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-sys\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-root\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-metrics-client-ca\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-wtmp\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.004882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.005192 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cmgj\" (UniqueName: \"kubernetes.io/projected/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-kube-api-access-9cmgj\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.005192 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.004952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-textfile\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.005361 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.005336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-metrics-client-ca\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.005482 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.005397 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.008539 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.008521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.008634 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.008527 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-node-exporter-tls\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.013156 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.013134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cmgj\" (UniqueName: \"kubernetes.io/projected/818ae179-eb0b-48ce-b01e-bb4c6eee9cbd-kube-api-access-9cmgj\") pod \"node-exporter-f2n4x\" (UID: \"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd\") " pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.071388 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.071349 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:19.133231 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.133159 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f2n4x" Sep 18 13:04:19.142612 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:04:19.142580 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818ae179_eb0b_48ce_b01e_bb4c6eee9cbd.slice/crio-a6d1af90fb1f6e7dfbc10e5b4d6517a1ef344a6640b2a1e79e134600c3ea6f57 WatchSource:0}: Error finding container a6d1af90fb1f6e7dfbc10e5b4d6517a1ef344a6640b2a1e79e134600c3ea6f57: Status 404 returned error can't find the container with id a6d1af90fb1f6e7dfbc10e5b4d6517a1ef344a6640b2a1e79e134600c3ea6f57 Sep 18 13:04:19.165119 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.165093 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:19.266597 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.266568 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:19.366675 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.366647 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:19.366798 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.366680 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:19.366798 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:19.366771 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:19.366918 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.366799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:19.366918 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:19.366898 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:19.367010 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:19.366927 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:19.763112 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:19.763068 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f2n4x" event={"ID":"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd","Type":"ContainerStarted","Data":"a6d1af90fb1f6e7dfbc10e5b4d6517a1ef344a6640b2a1e79e134600c3ea6f57"} Sep 18 13:04:20.179905 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.179880 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:20.277882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.277847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:20.366436 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.366355 2580 scope.go:117] "RemoveContainer" containerID="7c33d80d1925d5992e2282c80528bb193ea293ab823b9ab8e5882b2da5f7e8b0" Sep 18 13:04:20.750118 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.750085 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:20.767352 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.767329 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:04:20.767768 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.767425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hfnw" event={"ID":"27a05597-0b30-4d86-a40f-743c7965b10a","Type":"ContainerStarted","Data":"bd16bc4803440e1e0f96afcb753c8fcb412593d0b2b4caa833887d0f04f86b66"} Sep 18 13:04:20.768956 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.768934 2580 generic.go:356] "Generic (PLEG): container finished" podID="818ae179-eb0b-48ce-b01e-bb4c6eee9cbd" containerID="3e34328eb86c3d707730094360b844e09c84f1e2cd64604bba028f0183a9d731" exitCode=0 Sep 18 13:04:20.769051 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.768978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f2n4x" event={"ID":"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd","Type":"ContainerDied","Data":"3e34328eb86c3d707730094360b844e09c84f1e2cd64604bba028f0183a9d731"} Sep 18 13:04:20.847568 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:20.847543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:21.007736 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.007656 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:21.249161 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.249129 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:21.297597 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:21.297520 2580 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Sep 18 13:04:21.366473 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.366436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:21.366621 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.366470 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:21.366621 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:21.366548 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:21.366621 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:21.366598 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:21.366735 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.366632 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:21.366735 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:21.366706 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:21.383497 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.383469 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:21.773405 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.773363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f2n4x" event={"ID":"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd","Type":"ContainerStarted","Data":"1debd69e71e286274f27bc29798619239ce1b6813ad4581113a5297cdf312e7a"} Sep 18 13:04:21.773795 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.773434 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f2n4x" event={"ID":"818ae179-eb0b-48ce-b01e-bb4c6eee9cbd","Type":"ContainerStarted","Data":"50ad76ce2b7b1f13012b45cb3c62381c17c2f35a4bf45d14571f5f4974988f1e"} Sep 18 13:04:21.802421 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:21.802350 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f2n4x" podStartSLOduration=2.710171275 podStartE2EDuration="3.802334386s" totalImagesPullingTime="1.030187403s" totalInitContainerRuntime="61.975708ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:21.801274459 +0000 UTC m=+125.938748426" watchObservedRunningTime="2026-09-18 13:04:21.802334386 +0000 UTC m=+125.939808352" Sep 18 13:04:23.366665 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:23.366626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:23.367151 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:23.366633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:23.367151 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:23.366755 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:23.367151 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:23.366633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:23.367151 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:23.366810 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:23.367151 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:23.366886 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:23.609006 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:23.608972 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:23.784424 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:23.784368 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:24.181629 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:24.181596 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:24.429250 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:24.429215 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:24.645845 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:24.645768 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:25.366065 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:25.366029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:25.366246 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:25.366029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:25.366246 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:25.366142 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hwp4v" podUID="fa2fbfeb-7084-4c33-a604-24123f4420e9" Sep 18 13:04:25.366246 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:25.366223 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xk4hx" podUID="7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84" Sep 18 13:04:25.366461 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:25.366029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:25.366461 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:25.366319 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gl64v" podUID="11edae4f-2d74-48d5-a5e9-84027db1dae2" Sep 18 13:04:26.052372 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:26.052336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:26.052750 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.052512 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:04:26.052750 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.052583 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs podName:fa2fbfeb-7084-4c33-a604-24123f4420e9 nodeName:}" failed. No retries permitted until 2026-09-18 13:06:28.052566472 +0000 UTC m=+252.190040417 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs") pod "network-metrics-daemon-hwp4v" (UID: "fa2fbfeb-7084-4c33-a604-24123f4420e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 13:04:26.152830 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:26.152793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:26.152988 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:26.152845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:26.152988 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.152938 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 13:04:26.152988 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.152965 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 13:04:26.152988 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.152988 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret podName:7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84 nodeName:}" failed. No retries permitted until 2026-09-18 13:06:28.152975653 +0000 UTC m=+252.290449597 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret") pod "global-pull-secret-syncer-xk4hx" (UID: "7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84") : object "kube-system"/"original-pull-secret" not registered Sep 18 13:04:26.153115 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.152987 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 13:04:26.153115 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.153005 2580 projected.go:196] Error preparing data for projected volume kube-api-access-62k98 for pod openshift-network-diagnostics/network-check-target-gl64v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:04:26.153115 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:26.153027 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98 podName:11edae4f-2d74-48d5-a5e9-84027db1dae2 nodeName:}" failed. No retries permitted until 2026-09-18 13:06:28.153020999 +0000 UTC m=+252.290494943 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "kube-api-access-62k98" (UniqueName: "kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98") pod "network-check-target-gl64v" (UID: "11edae4f-2d74-48d5-a5e9-84027db1dae2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 13:04:26.522192 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:26.522162 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:26.986923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:26.986889 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:27.366219 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.366188 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:04:27.366621 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.366297 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:04:27.366621 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.366326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:04:27.373117 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.372852 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:04:27.375057 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.375038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npxzw\"" Sep 18 13:04:27.375157 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.375048 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:04:27.375434 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.375418 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m78j\"" Sep 18 13:04:27.375518 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.375502 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:04:27.375937 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:27.375923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:04:29.377044 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:29.377019 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gtdt2" Sep 18 13:04:29.734507 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:29.734478 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-58.ec2.internal" event="NodeReady" Sep 18 13:04:29.839138 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:29.839110 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:30.002841 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.002766 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nwjk9"] Sep 18 13:04:30.005439 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.005417 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jj6gh"] Sep 18 13:04:30.005578 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.005520 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:30.007413 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.007394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.013888 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013855 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"canary-serving-cert\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013894 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013907 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013905 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-sghv7\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sghv7\"" type="*v1.Secret" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013897 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"ingress-canary-nwjk9\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" podUID="9d9dccf0-6fa5-4103-97cd-56d71a40823e" pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013957 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-7v6wx\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7v6wx\"" type="*v1.Secret" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013969 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013969 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 18 13:04:30.014003 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.013919 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Sep 18 13:04:30.014336 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:30.014012 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-58.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-135-58.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 18 13:04:30.043197 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.043174 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nwjk9"] Sep 18 13:04:30.049245 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.049226 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jj6gh"] Sep 18 13:04:30.079488 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.079467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b2abd9c-a1ee-426a-a211-a7b560938d92-crio-socket\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.079577 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.079491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b2abd9c-a1ee-426a-a211-a7b560938d92-data-volume\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.079577 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.079518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml2dg\" (UniqueName: \"kubernetes.io/projected/9d9dccf0-6fa5-4103-97cd-56d71a40823e-kube-api-access-ml2dg\") pod \"ingress-canary-nwjk9\" (UID: \"9d9dccf0-6fa5-4103-97cd-56d71a40823e\") " pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:30.079577 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.079535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.079670 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.079605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b2abd9c-a1ee-426a-a211-a7b560938d92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.079670 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.079639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d9dccf0-6fa5-4103-97cd-56d71a40823e-cert\") pod \"ingress-canary-nwjk9\" (UID: \"9d9dccf0-6fa5-4103-97cd-56d71a40823e\") " pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:30.079670 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.079659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txkst\" (UniqueName: \"kubernetes.io/projected/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-api-access-txkst\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.151873 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.151842 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fm2lz"] Sep 18 13:04:30.153823 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.153809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.170005 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.169978 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 13:04:30.170005 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.169997 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kdhzl\"" Sep 18 13:04:30.170163 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.169998 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 13:04:30.180040 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b2abd9c-a1ee-426a-a211-a7b560938d92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.180131 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d9dccf0-6fa5-4103-97cd-56d71a40823e-cert\") pod \"ingress-canary-nwjk9\" (UID: \"9d9dccf0-6fa5-4103-97cd-56d71a40823e\") " pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:30.180131 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b538f319-13b1-4273-bb7c-c281a510a49d-metrics-tls\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.180234 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txkst\" (UniqueName: \"kubernetes.io/projected/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-api-access-txkst\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.180290 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b538f319-13b1-4273-bb7c-c281a510a49d-config-volume\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.180340 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b538f319-13b1-4273-bb7c-c281a510a49d-tmp-dir\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.180457 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b2abd9c-a1ee-426a-a211-a7b560938d92-crio-socket\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.180786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b2abd9c-a1ee-426a-a211-a7b560938d92-crio-socket\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.180786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b2abd9c-a1ee-426a-a211-a7b560938d92-data-volume\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.180786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhvzs\" (UniqueName: \"kubernetes.io/projected/b538f319-13b1-4273-bb7c-c281a510a49d-kube-api-access-fhvzs\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.180786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2dg\" (UniqueName: \"kubernetes.io/projected/9d9dccf0-6fa5-4103-97cd-56d71a40823e-kube-api-access-ml2dg\") pod \"ingress-canary-nwjk9\" (UID: \"9d9dccf0-6fa5-4103-97cd-56d71a40823e\") " pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:30.180786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.180786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fm2lz"] Sep 18 13:04:30.181011 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.180870 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b2abd9c-a1ee-426a-a211-a7b560938d92-data-volume\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:30.280756 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.280664 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:30.280934 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.280915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b538f319-13b1-4273-bb7c-c281a510a49d-metrics-tls\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.280980 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.280945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b538f319-13b1-4273-bb7c-c281a510a49d-config-volume\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.280980 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.280962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b538f319-13b1-4273-bb7c-c281a510a49d-tmp-dir\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.281042 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.281005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhvzs\" (UniqueName: \"kubernetes.io/projected/b538f319-13b1-4273-bb7c-c281a510a49d-kube-api-access-fhvzs\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.281411 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.281394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b538f319-13b1-4273-bb7c-c281a510a49d-tmp-dir\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.281465 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.281434 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b538f319-13b1-4273-bb7c-c281a510a49d-config-volume\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.283241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.283227 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b538f319-13b1-4273-bb7c-c281a510a49d-metrics-tls\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.344979 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.344947 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhvzs\" (UniqueName: \"kubernetes.io/projected/b538f319-13b1-4273-bb7c-c281a510a49d-kube-api-access-fhvzs\") pod \"dns-default-fm2lz\" (UID: \"b538f319-13b1-4273-bb7c-c281a510a49d\") " pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.457297 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.457267 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:04:30.459955 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.459938 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.461606 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.461587 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:30.468331 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 13:04:30.468487 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468361 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 13:04:30.468487 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468370 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 13:04:30.468664 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468647 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 13:04:30.468738 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468718 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 13:04:30.468869 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468838 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 13:04:30.468968 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468841 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 13:04:30.468968 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468958 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 13:04:30.469090 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468971 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 13:04:30.469090 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.468990 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b9tnvelqlo9n8\"" Sep 18 13:04:30.469289 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.469273 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 13:04:30.469345 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.469306 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 13:04:30.474950 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.474919 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 13:04:30.481024 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.480494 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 13:04:30.481024 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.480939 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5v4tp\"" Sep 18 13:04:30.483846 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.481822 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 13:04:30.483943 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.483919 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 13:04:30.502591 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.502561 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:30.528610 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.528586 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:04:30.583172 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583172 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-config\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583172 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583350 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583350 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583350 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583350 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583313 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583350 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbbbd\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-kube-api-access-zbbbd\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583576 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.583878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.583776 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684501 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684501 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684698 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684698 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684905 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684905 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684757 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684905 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.684905 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.684852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.685300 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685274 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685428 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-config\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685611 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbbbd\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-kube-api-access-zbbbd\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.685789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.686054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.686725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.686360 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.687916 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.687893 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.687997 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.687963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.688062 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.688030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.688121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.688066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.688860 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.688533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-config\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.688860 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.688637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.688860 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.688745 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.689615 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.689585 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.689891 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.689871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.690733 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.690706 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.690859 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.690846 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.691080 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.691058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.691409 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.691394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.701952 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.701928 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbbbd\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-kube-api-access-zbbbd\") pod \"prometheus-k8s-0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.769963 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.769926 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:30.789288 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.789262 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fm2lz"] Sep 18 13:04:30.792198 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:04:30.792175 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb538f319_13b1_4273_bb7c_c281a510a49d.slice/crio-433854e9c423a9672fe060e301675bb2e72bf80ace2fe82dd24fac665badebe7 WatchSource:0}: Error finding container 433854e9c423a9672fe060e301675bb2e72bf80ace2fe82dd24fac665badebe7: Status 404 returned error can't find the container with id 433854e9c423a9672fe060e301675bb2e72bf80ace2fe82dd24fac665badebe7 Sep 18 13:04:30.795933 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.795906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fm2lz" event={"ID":"b538f319-13b1-4273-bb7c-c281a510a49d","Type":"ContainerStarted","Data":"433854e9c423a9672fe060e301675bb2e72bf80ace2fe82dd24fac665badebe7"} Sep 18 13:04:30.855824 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.855756 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 13:04:30.875431 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.875406 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 13:04:30.888635 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.888615 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 13:04:30.893026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:30.893005 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d9dccf0-6fa5-4103-97cd-56d71a40823e-cert\") pod \"ingress-canary-nwjk9\" (UID: \"9d9dccf0-6fa5-4103-97cd-56d71a40823e\") " pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:31.086451 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.086406 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 13:04:31.086802 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.086783 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:04:31.089665 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:04:31.089640 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb81022_d8a4_41f1_b089_491475a151c0.slice/crio-6bb1fc2d17e73f6e2ea8fc37ca728b858f163190eaa473a3f70e46bd58e810c1 WatchSource:0}: Error finding container 6bb1fc2d17e73f6e2ea8fc37ca728b858f163190eaa473a3f70e46bd58e810c1: Status 404 returned error can't find the container with id 6bb1fc2d17e73f6e2ea8fc37ca728b858f163190eaa473a3f70e46bd58e810c1 Sep 18 13:04:31.091428 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.091412 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txkst\" (UniqueName: \"kubernetes.io/projected/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-api-access-txkst\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:31.180314 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:31.180240 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition Sep 18 13:04:31.180553 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:31.180328 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2abd9c-a1ee-426a-a211-a7b560938d92-insights-runtime-extractor-tls podName:1b2abd9c-a1ee-426a-a211-a7b560938d92 nodeName:}" failed. No retries permitted until 2026-09-18 13:04:31.680306829 +0000 UTC m=+135.817780774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b2abd9c-a1ee-426a-a211-a7b560938d92-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jj6gh" (UID: "1b2abd9c-a1ee-426a-a211-a7b560938d92") : failed to sync secret cache: timed out waiting for the condition Sep 18 13:04:31.181423 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:31.181402 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Sep 18 13:04:31.181615 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:31.181473 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-rbac-proxy-cm podName:1b2abd9c-a1ee-426a-a211-a7b560938d92 nodeName:}" failed. No retries permitted until 2026-09-18 13:04:31.681458179 +0000 UTC m=+135.818932125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jj6gh" (UID: "1b2abd9c-a1ee-426a-a211-a7b560938d92") : failed to sync configmap cache: timed out waiting for the condition Sep 18 13:04:31.211059 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.211030 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 13:04:31.218309 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:31.218285 2580 projected.go:291] Couldn't get configMap openshift-ingress-canary/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Sep 18 13:04:31.218412 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:31.218322 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ml2dg for pod openshift-ingress-canary/ingress-canary-nwjk9: failed to sync configmap cache: timed out waiting for the condition Sep 18 13:04:31.218412 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:04:31.218396 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9dccf0-6fa5-4103-97cd-56d71a40823e-kube-api-access-ml2dg podName:9d9dccf0-6fa5-4103-97cd-56d71a40823e nodeName:}" failed. No retries permitted until 2026-09-18 13:04:31.718362871 +0000 UTC m=+135.855836823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ml2dg" (UniqueName: "kubernetes.io/projected/9d9dccf0-6fa5-4103-97cd-56d71a40823e-kube-api-access-ml2dg") pod "ingress-canary-nwjk9" (UID: "9d9dccf0-6fa5-4103-97cd-56d71a40823e") : failed to sync configmap cache: timed out waiting for the condition Sep 18 13:04:31.365567 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.365535 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sghv7\"" Sep 18 13:04:31.375907 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.375884 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 13:04:31.385573 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.385555 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 13:04:31.425356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.425337 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7v6wx\"" Sep 18 13:04:31.694774 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.694737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:31.695225 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.694824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b2abd9c-a1ee-426a-a211-a7b560938d92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:31.695454 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.695434 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b2abd9c-a1ee-426a-a211-a7b560938d92-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:31.698031 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.697985 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b2abd9c-a1ee-426a-a211-a7b560938d92-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jj6gh\" (UID: \"1b2abd9c-a1ee-426a-a211-a7b560938d92\") " pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:31.795285 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.795234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2dg\" (UniqueName: \"kubernetes.io/projected/9d9dccf0-6fa5-4103-97cd-56d71a40823e-kube-api-access-ml2dg\") pod \"ingress-canary-nwjk9\" (UID: \"9d9dccf0-6fa5-4103-97cd-56d71a40823e\") " pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:31.798137 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.798106 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml2dg\" (UniqueName: \"kubernetes.io/projected/9d9dccf0-6fa5-4103-97cd-56d71a40823e-kube-api-access-ml2dg\") pod \"ingress-canary-nwjk9\" (UID: \"9d9dccf0-6fa5-4103-97cd-56d71a40823e\") " pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:31.799854 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.799823 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerStarted","Data":"6bb1fc2d17e73f6e2ea8fc37ca728b858f163190eaa473a3f70e46bd58e810c1"} Sep 18 13:04:31.814993 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.814966 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nwjk9" Sep 18 13:04:31.820128 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:31.820109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jj6gh" Sep 18 13:04:32.805257 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.805226 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fm2lz" event={"ID":"b538f319-13b1-4273-bb7c-c281a510a49d","Type":"ContainerStarted","Data":"3edcef92cb60832c929c66e8d158c2a9e98df0a5620aca21143aedb5501bbefe"} Sep 18 13:04:32.805681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.805280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fm2lz" event={"ID":"b538f319-13b1-4273-bb7c-c281a510a49d","Type":"ContainerStarted","Data":"1178eb9b7c5e57dbe7b5ba16bf15b46a6fc8f8cd5be004c4eb187d25955476ad"} Sep 18 13:04:32.805681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.805311 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:32.806908 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.806887 2580 generic.go:356] "Generic (PLEG): container finished" podID="3fb81022-d8a4-41f1-b089-491475a151c0" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" exitCode=0 Sep 18 13:04:32.807096 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.806934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2"} Sep 18 13:04:32.904673 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.904119 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fm2lz" podStartSLOduration=1.089337949 podStartE2EDuration="2.904101372s" totalImagesPullingTime="1.814763423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:32.847934879 +0000 UTC m=+136.985408845" watchObservedRunningTime="2026-09-18 13:04:32.904101372 +0000 UTC m=+137.041575338" Sep 18 13:04:32.905060 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.905040 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jj6gh"] Sep 18 13:04:32.908720 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:04:32.908698 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2abd9c_a1ee_426a_a211_a7b560938d92.slice/crio-ebd163fd3f1804368c748b1953347eb3e5d66f70ee6e3295d6df4141176d8598 WatchSource:0}: Error finding container ebd163fd3f1804368c748b1953347eb3e5d66f70ee6e3295d6df4141176d8598: Status 404 returned error can't find the container with id ebd163fd3f1804368c748b1953347eb3e5d66f70ee6e3295d6df4141176d8598 Sep 18 13:04:32.916236 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:32.916215 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nwjk9"] Sep 18 13:04:32.920344 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:04:32.919431 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9dccf0_6fa5_4103_97cd_56d71a40823e.slice/crio-fc13942bb157b02493af3747fc8a06c9fe28f3d55b41a00ce83f4ecde6f35728 WatchSource:0}: Error finding container fc13942bb157b02493af3747fc8a06c9fe28f3d55b41a00ce83f4ecde6f35728: Status 404 returned error can't find the container with id fc13942bb157b02493af3747fc8a06c9fe28f3d55b41a00ce83f4ecde6f35728 Sep 18 13:04:33.276184 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:33.276151 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:33.446954 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:33.446895 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:33.814488 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:33.814436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jj6gh" event={"ID":"1b2abd9c-a1ee-426a-a211-a7b560938d92","Type":"ContainerStarted","Data":"2ba3cfb4af5820ae4c5d5907026c5995b5a3928bcbc6f69ecfff823fcf820c57"} Sep 18 13:04:33.814859 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:33.814506 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jj6gh" event={"ID":"1b2abd9c-a1ee-426a-a211-a7b560938d92","Type":"ContainerStarted","Data":"ebd163fd3f1804368c748b1953347eb3e5d66f70ee6e3295d6df4141176d8598"} Sep 18 13:04:33.816844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:33.816816 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nwjk9" event={"ID":"9d9dccf0-6fa5-4103-97cd-56d71a40823e","Type":"ContainerStarted","Data":"fc13942bb157b02493af3747fc8a06c9fe28f3d55b41a00ce83f4ecde6f35728"} Sep 18 13:04:33.851849 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:33.851820 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:34.034133 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:34.034048 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:34.823845 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:34.823809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jj6gh" event={"ID":"1b2abd9c-a1ee-426a-a211-a7b560938d92","Type":"ContainerStarted","Data":"7a1c14b2c88927a9b3d2c42fcebc618cdcc854fee2a8de245965fb4d587ac896"} Sep 18 13:04:36.186372 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:36.186326 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:36.331497 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:36.331444 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:37.835651 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:37.835616 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jj6gh" event={"ID":"1b2abd9c-a1ee-426a-a211-a7b560938d92","Type":"ContainerStarted","Data":"5784bb698fc86ad41a6443c3fd7cd3eedf3319726ec4ad3d06f0f994e246f2f8"} Sep 18 13:04:37.837161 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:37.837134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nwjk9" event={"ID":"9d9dccf0-6fa5-4103-97cd-56d71a40823e","Type":"ContainerStarted","Data":"b14abbbe76c3a0fca8315fd236b031583db2033a6f719d7924d27d8860476c8d"} Sep 18 13:04:37.839219 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:37.839200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerStarted","Data":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} Sep 18 13:04:37.839322 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:37.839250 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerStarted","Data":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} Sep 18 13:04:37.870757 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:37.870691 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jj6gh" podStartSLOduration=4.934701968 podStartE2EDuration="8.87067194s" totalImagesPullingTime="3.935969972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:04:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:37.870084269 +0000 UTC m=+142.007558248" watchObservedRunningTime="2026-09-18 13:04:37.87067194 +0000 UTC m=+142.008145911" Sep 18 13:04:39.849739 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:39.849699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerStarted","Data":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} Sep 18 13:04:39.850130 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:39.849820 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerStarted","Data":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} Sep 18 13:04:39.850130 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:39.849864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerStarted","Data":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} Sep 18 13:04:39.850130 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:39.849908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerStarted","Data":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} Sep 18 13:04:39.898656 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:39.898600 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nwjk9" podStartSLOduration=6.85803062 podStartE2EDuration="10.898584386s" totalImagesPullingTime="4.040553766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:37.910751347 +0000 UTC m=+142.048225315" watchObservedRunningTime="2026-09-18 13:04:39.898584386 +0000 UTC m=+144.036058380" Sep 18 13:04:39.898935 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:39.898906 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.47972821 podStartE2EDuration="9.898898393s" totalImagesPullingTime="7.395035092s" totalInitContainerRuntime="24.135091ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:04:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:04:39.89730317 +0000 UTC m=+144.034777137" watchObservedRunningTime="2026-09-18 13:04:39.898898393 +0000 UTC m=+144.036372359" Sep 18 13:04:40.770335 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:40.770296 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:04:42.819238 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:42.819206 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fm2lz" Sep 18 13:04:51.188213 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:51.188176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:51.312166 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:51.312132 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:54.249258 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:54.249226 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:54.386692 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:54.386663 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:57.976231 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:57.976198 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:58.175484 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:58.175449 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:58.653436 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:58.653402 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:58.821436 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:58.821399 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:59.238831 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:59.238799 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:04:59.533912 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:04:59.533826 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:00.331349 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:00.331321 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:00.528617 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:00.528585 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:01.488439 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.488402 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665f888b78-lp4xp"] Sep 18 13:05:01.493228 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.493207 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.511425 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.511405 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 13:05:01.512072 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.512057 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 13:05:01.512132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.512102 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 13:05:01.512202 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.512191 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kwflb\"" Sep 18 13:05:01.513123 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.513105 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 13:05:01.513215 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.513158 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 13:05:01.532061 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.532042 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 13:05:01.643796 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.643771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-oauth-serving-cert\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.643904 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.643817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-serving-cert\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.643904 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.643879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-oauth-config\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.643904 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.643898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-config\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.644017 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.643935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz5rg\" (UniqueName: \"kubernetes.io/projected/a28d72d2-dc61-4a7f-9721-6bb3755c752a-kube-api-access-mz5rg\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.644017 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.643978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-service-ca\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.649085 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.649071 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 13:05:01.745337 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.745271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-serving-cert\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.745337 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.745324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-oauth-config\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.745524 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.745350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-config\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.745524 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.745366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz5rg\" (UniqueName: \"kubernetes.io/projected/a28d72d2-dc61-4a7f-9721-6bb3755c752a-kube-api-access-mz5rg\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.745524 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.745507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-service-ca\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.745676 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.745560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-oauth-serving-cert\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.746063 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.746040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-config\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.746139 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.746083 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-service-ca\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.746253 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.746231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-oauth-serving-cert\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.747591 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.747570 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-oauth-config\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.747708 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.747692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-serving-cert\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.781614 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.781591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz5rg\" (UniqueName: \"kubernetes.io/projected/a28d72d2-dc61-4a7f-9721-6bb3755c752a-kube-api-access-mz5rg\") pod \"console-665f888b78-lp4xp\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.795571 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.795548 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665f888b78-lp4xp"] Sep 18 13:05:01.801517 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.801490 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:01.914258 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:01.914224 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:02.131108 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:02.131011 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665f888b78-lp4xp"] Sep 18 13:05:02.133801 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:05:02.133778 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28d72d2_dc61_4a7f_9721_6bb3755c752a.slice/crio-686f685c63f983594774f8b4e26e2b030d66ea680b70673774c089a9f9ae1c15 WatchSource:0}: Error finding container 686f685c63f983594774f8b4e26e2b030d66ea680b70673774c089a9f9ae1c15: Status 404 returned error can't find the container with id 686f685c63f983594774f8b4e26e2b030d66ea680b70673774c089a9f9ae1c15 Sep 18 13:05:02.182494 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:02.182464 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:02.921839 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:02.921764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665f888b78-lp4xp" event={"ID":"a28d72d2-dc61-4a7f-9721-6bb3755c752a","Type":"ContainerStarted","Data":"686f685c63f983594774f8b4e26e2b030d66ea680b70673774c089a9f9ae1c15"} Sep 18 13:05:03.014599 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.014533 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:03.123243 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.123157 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:03.215028 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.214994 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7498647c79-bkmmb"] Sep 18 13:05:03.218719 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.218701 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.229975 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.229949 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 13:05:03.267603 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.267534 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7498647c79-bkmmb"] Sep 18 13:05:03.360208 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.360168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmst\" (UniqueName: \"kubernetes.io/projected/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-kube-api-access-ctmst\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.360208 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.360210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-config\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.360432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.360282 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-oauth-serving-cert\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.360432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.360332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-serving-cert\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.360432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.360371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-oauth-config\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.360432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.360402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-trusted-ca-bundle\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.360607 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.360490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-service-ca\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.461969 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.461908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-serving-cert\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.462158 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-oauth-config\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.462158 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-trusted-ca-bundle\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.462158 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-service-ca\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.462158 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmst\" (UniqueName: \"kubernetes.io/projected/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-kube-api-access-ctmst\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.462425 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-config\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.462425 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-oauth-serving-cert\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.463110 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462910 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-oauth-serving-cert\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.463110 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.462979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-trusted-ca-bundle\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.463252 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.463185 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-config\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.463480 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.463462 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-service-ca\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.465194 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.465132 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-oauth-config\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.465725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.465705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-serving-cert\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.477602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.477559 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmst\" (UniqueName: \"kubernetes.io/projected/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-kube-api-access-ctmst\") pod \"console-7498647c79-bkmmb\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:03.530740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:03.530556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:06.253824 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:06.253796 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7498647c79-bkmmb"] Sep 18 13:05:06.255914 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:05:06.255881 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ce4cc1_c492_40f1_9ec5_065516a5fbc9.slice/crio-6730a2df3e084f84c66bec06740a11db69ff8752ad885f912552e2d1d2b0e52d WatchSource:0}: Error finding container 6730a2df3e084f84c66bec06740a11db69ff8752ad885f912552e2d1d2b0e52d: Status 404 returned error can't find the container with id 6730a2df3e084f84c66bec06740a11db69ff8752ad885f912552e2d1d2b0e52d Sep 18 13:05:06.938325 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:06.938291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665f888b78-lp4xp" event={"ID":"a28d72d2-dc61-4a7f-9721-6bb3755c752a","Type":"ContainerStarted","Data":"dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4"} Sep 18 13:05:06.939795 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:06.939768 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7498647c79-bkmmb" event={"ID":"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9","Type":"ContainerStarted","Data":"ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1"} Sep 18 13:05:06.939908 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:06.939808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7498647c79-bkmmb" event={"ID":"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9","Type":"ContainerStarted","Data":"6730a2df3e084f84c66bec06740a11db69ff8752ad885f912552e2d1d2b0e52d"} Sep 18 13:05:07.001904 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:07.001751 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665f888b78-lp4xp" podStartSLOduration=2.125306013 podStartE2EDuration="6.001736086s" totalImagesPullingTime="3.876430073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:05:07.00172544 +0000 UTC m=+171.139199407" watchObservedRunningTime="2026-09-18 13:05:07.001736086 +0000 UTC m=+171.139210055" Sep 18 13:05:07.034355 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:07.034311 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7498647c79-bkmmb" podStartSLOduration=4.034295607 podStartE2EDuration="4.034295607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:05:07.033989995 +0000 UTC m=+171.171463962" watchObservedRunningTime="2026-09-18 13:05:07.034295607 +0000 UTC m=+171.171769574" Sep 18 13:05:07.603548 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:07.603514 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:07.740684 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:07.740647 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:11.802416 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:11.802246 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:11.802416 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:11.802309 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:11.807015 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:11.806993 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:11.958909 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:11.958878 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:12.176251 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:12.176170 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:12.275735 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:12.275699 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:12.821811 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:12.821780 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:12.981235 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:12.981203 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:13.334792 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:13.334763 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:13.530810 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:13.530778 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:13.530954 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:13.530866 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:13.536081 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:13.536054 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:13.580753 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:13.580724 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:13.674953 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:13.674871 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:13.965323 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:13.965296 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:05:14.085256 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:14.085225 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665f888b78-lp4xp"] Sep 18 13:05:14.338887 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:14.338802 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:14.550779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:14.550747 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:21.293639 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:21.293596 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:21.427766 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:21.427727 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:27.767520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:27.767488 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:27.919557 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:27.919488 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:30.770435 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:30.770396 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:30.788631 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:30.788606 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:31.033635 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:31.033562 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:36.208500 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:36.208457 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:36.368394 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:36.368355 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:39.103483 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.103418 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-665f888b78-lp4xp" podUID="a28d72d2-dc61-4a7f-9721-6bb3755c752a" containerName="console" containerID="cri-o://dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4" gracePeriod=15 Sep 18 13:05:39.351398 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.351360 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:39.486893 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.486856 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-serving-cert\") pod \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " Sep 18 13:05:39.487082 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.486911 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-oauth-serving-cert\") pod \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " Sep 18 13:05:39.487082 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.486937 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz5rg\" (UniqueName: \"kubernetes.io/projected/a28d72d2-dc61-4a7f-9721-6bb3755c752a-kube-api-access-mz5rg\") pod \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " Sep 18 13:05:39.487082 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.486964 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-config\") pod \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " Sep 18 13:05:39.487082 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.486987 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-service-ca\") pod \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " Sep 18 13:05:39.487082 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.487011 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-oauth-config\") pod \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\" (UID: \"a28d72d2-dc61-4a7f-9721-6bb3755c752a\") " Sep 18 13:05:39.487453 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.487417 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-config" (OuterVolumeSpecName: "console-config") pod "a28d72d2-dc61-4a7f-9721-6bb3755c752a" (UID: "a28d72d2-dc61-4a7f-9721-6bb3755c752a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:39.487453 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.487448 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a28d72d2-dc61-4a7f-9721-6bb3755c752a" (UID: "a28d72d2-dc61-4a7f-9721-6bb3755c752a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:39.487648 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.487477 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a28d72d2-dc61-4a7f-9721-6bb3755c752a" (UID: "a28d72d2-dc61-4a7f-9721-6bb3755c752a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:39.489277 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.489250 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a28d72d2-dc61-4a7f-9721-6bb3755c752a-kube-api-access-mz5rg" (OuterVolumeSpecName: "kube-api-access-mz5rg") pod "a28d72d2-dc61-4a7f-9721-6bb3755c752a" (UID: "a28d72d2-dc61-4a7f-9721-6bb3755c752a"). InnerVolumeSpecName "kube-api-access-mz5rg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:05:39.489364 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.489273 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a28d72d2-dc61-4a7f-9721-6bb3755c752a" (UID: "a28d72d2-dc61-4a7f-9721-6bb3755c752a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:39.489364 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.489289 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a28d72d2-dc61-4a7f-9721-6bb3755c752a" (UID: "a28d72d2-dc61-4a7f-9721-6bb3755c752a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:39.587637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.587598 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz5rg\" (UniqueName: \"kubernetes.io/projected/a28d72d2-dc61-4a7f-9721-6bb3755c752a-kube-api-access-mz5rg\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:39.587637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.587629 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:39.587637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.587638 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-service-ca\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:39.587637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.587646 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-oauth-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:39.587875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.587655 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a28d72d2-dc61-4a7f-9721-6bb3755c752a-console-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:39.587875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:39.587664 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a28d72d2-dc61-4a7f-9721-6bb3755c752a-oauth-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:40.046932 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.046894 2580 generic.go:356] "Generic (PLEG): container finished" podID="a28d72d2-dc61-4a7f-9721-6bb3755c752a" containerID="dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4" exitCode=0 Sep 18 13:05:40.047078 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.046941 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665f888b78-lp4xp" Sep 18 13:05:40.047078 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.046948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665f888b78-lp4xp" event={"ID":"a28d72d2-dc61-4a7f-9721-6bb3755c752a","Type":"ContainerDied","Data":"dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4"} Sep 18 13:05:40.047078 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.046989 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665f888b78-lp4xp" event={"ID":"a28d72d2-dc61-4a7f-9721-6bb3755c752a","Type":"ContainerDied","Data":"686f685c63f983594774f8b4e26e2b030d66ea680b70673774c089a9f9ae1c15"} Sep 18 13:05:40.047078 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.047008 2580 scope.go:117] "RemoveContainer" containerID="dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4" Sep 18 13:05:40.055870 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.055851 2580 scope.go:117] "RemoveContainer" containerID="dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4" Sep 18 13:05:40.056131 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:40.056110 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4\": container with ID starting with dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4 not found: ID does not exist" containerID="dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4" Sep 18 13:05:40.056202 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.056137 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4"} err="failed to get container status \"dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4\": rpc error: code = NotFound desc = could not find container \"dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4\": container with ID starting with dfbf7156a685744873c2e68ffae04de47a1f09b79b99bc4f252154ead2d734c4 not found: ID does not exist" Sep 18 13:05:40.075550 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.075524 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665f888b78-lp4xp"] Sep 18 13:05:40.081165 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.081144 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665f888b78-lp4xp"] Sep 18 13:05:40.369857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:40.369777 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a28d72d2-dc61-4a7f-9721-6bb3755c752a" path="/var/lib/kubelet/pods/a28d72d2-dc61-4a7f-9721-6bb3755c752a/volumes" Sep 18 13:05:43.146389 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:43.146342 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:43.280465 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:43.280437 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:48.268856 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.268817 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm"] Sep 18 13:05:48.269332 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.269077 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a28d72d2-dc61-4a7f-9721-6bb3755c752a" containerName="console" Sep 18 13:05:48.269332 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.269096 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a28d72d2-dc61-4a7f-9721-6bb3755c752a" containerName="console" Sep 18 13:05:48.269332 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.269176 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a28d72d2-dc61-4a7f-9721-6bb3755c752a" containerName="console" Sep 18 13:05:48.272121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.272104 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.274762 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.274744 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 13:05:48.275229 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.275208 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 13:05:48.275351 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.275293 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 13:05:48.275351 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.275327 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 13:05:48.275629 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.275615 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 13:05:48.275765 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.275749 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d5dw7\"" Sep 18 13:05:48.282942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.282921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 13:05:48.312816 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.312781 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm"] Sep 18 13:05:48.354495 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-telemeter-client-tls\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.354649 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-serving-certs-ca-bundle\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.354649 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-federate-client-tls\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.354649 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.354649 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.354649 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354631 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svlmw\" (UniqueName: \"kubernetes.io/projected/bd6f3708-93d3-4a49-9b5d-905bdd831e31-kube-api-access-svlmw\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.354835 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-secret-telemeter-client\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.354835 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.354703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-metrics-client-ca\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455678 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455678 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455678 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlmw\" (UniqueName: \"kubernetes.io/projected/bd6f3708-93d3-4a49-9b5d-905bdd831e31-kube-api-access-svlmw\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455985 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-secret-telemeter-client\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455985 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-metrics-client-ca\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455985 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-telemeter-client-tls\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455985 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-serving-certs-ca-bundle\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.455985 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.455843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-federate-client-tls\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.456692 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.456664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-metrics-client-ca\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.456817 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.456664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-serving-certs-ca-bundle\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.456817 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.456700 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd6f3708-93d3-4a49-9b5d-905bdd831e31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.458473 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.458446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-federate-client-tls\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.458592 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.458503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-telemeter-client-tls\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.458651 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.458614 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.458651 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.458625 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd6f3708-93d3-4a49-9b5d-905bdd831e31-secret-telemeter-client\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.465224 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.465206 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svlmw\" (UniqueName: \"kubernetes.io/projected/bd6f3708-93d3-4a49-9b5d-905bdd831e31-kube-api-access-svlmw\") pod \"telemeter-client-6cf599d4bd-vfwsm\" (UID: \"bd6f3708-93d3-4a49-9b5d-905bdd831e31\") " pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.581412 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.581291 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" Sep 18 13:05:48.601357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.601328 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:05:48.601702 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.601673 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="prometheus" containerID="cri-o://3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" gracePeriod=600 Sep 18 13:05:48.601857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.601812 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="config-reloader" containerID="cri-o://82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" gracePeriod=600 Sep 18 13:05:48.601986 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.601741 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-web" containerID="cri-o://82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" gracePeriod=600 Sep 18 13:05:48.601986 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.601680 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy" containerID="cri-o://3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" gracePeriod=600 Sep 18 13:05:48.601986 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.601759 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="thanos-sidecar" containerID="cri-o://5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" gracePeriod=600 Sep 18 13:05:48.602137 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.601753 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" gracePeriod=600 Sep 18 13:05:48.837079 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.837020 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:48.858132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858102 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-config-out\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858269 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858137 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-metrics-client-ca\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858269 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858172 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-kubelet-serving-ca-bundle\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858269 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858196 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-tls-assets\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858269 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858228 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-config\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858499 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858331 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-web-config\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858499 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858405 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-kube-rbac-proxy\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858499 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858440 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-grpc-tls\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858499 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858477 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-trusted-ca-bundle\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858503 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbbbd\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-kube-api-access-zbbbd\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858531 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-db\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858560 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-thanos-prometheus-http-client-file\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858568 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:48.858703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858586 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-0\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858641 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-2\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.858703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858644 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:48.859039 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.858984 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-metrics-client-ca\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.859039 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.859004 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.859191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.859166 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:48.860478 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.859310 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:48.860478 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.860170 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:48.860644 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.860585 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:05:48.861009 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.860949 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-config" (OuterVolumeSpecName: "config") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.861249 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.861223 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:05:48.861488 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.861461 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-config-out" (OuterVolumeSpecName: "config-out") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:05:48.861638 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.861619 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.861708 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.861645 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.862166 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.862142 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.862693 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.862671 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-kube-api-access-zbbbd" (OuterVolumeSpecName: "kube-api-access-zbbbd") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "kube-api-access-zbbbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:05:48.867662 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.867640 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm"] Sep 18 13:05:48.870755 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.870734 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-web-config" (OuterVolumeSpecName: "web-config") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.871187 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:05:48.871164 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6f3708_93d3_4a49_9b5d_905bdd831e31.slice/crio-0163b7b764e3dd59bd9496c1516899b73ad9d8fa9a159bc92ea7fde1431ff16d WatchSource:0}: Error finding container 0163b7b764e3dd59bd9496c1516899b73ad9d8fa9a159bc92ea7fde1431ff16d: Status 404 returned error can't find the container with id 0163b7b764e3dd59bd9496c1516899b73ad9d8fa9a159bc92ea7fde1431ff16d Sep 18 13:05:48.959625 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.959595 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.959774 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.959634 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-1\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.959774 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.959662 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.959774 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.959755 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-serving-certs-ca-bundle\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.959944 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.959784 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-tls\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.959944 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.959808 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-metrics-client-certs\") pod \"3fb81022-d8a4-41f1-b089-491475a151c0\" (UID: \"3fb81022-d8a4-41f1-b089-491475a151c0\") " Sep 18 13:05:48.960050 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.959988 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:48.960050 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960025 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960050 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960045 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-web-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960059 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-kube-rbac-proxy\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960072 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-grpc-tls\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960087 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960084 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960100 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbbbd\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-kube-api-access-zbbbd\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960114 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-db\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960129 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960143 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960157 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960172 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fb81022-d8a4-41f1-b089-491475a151c0-config-out\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.960199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.960186 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fb81022-d8a4-41f1-b089-491475a151c0-tls-assets\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:48.961689 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.961665 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.961833 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.961814 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.962081 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.962058 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:48.962081 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:48.962069 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3fb81022-d8a4-41f1-b089-491475a151c0" (UID: "3fb81022-d8a4-41f1-b089-491475a151c0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:05:49.060952 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.060918 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:49.060952 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.060947 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:49.060952 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.060956 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-metrics-client-certs\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:49.061154 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.060965 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:49.061154 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.060975 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fb81022-d8a4-41f1-b089-491475a151c0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:49.061154 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.060984 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fb81022-d8a4-41f1-b089-491475a151c0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:05:49.081980 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.081952 2580 generic.go:356] "Generic (PLEG): container finished" podID="3fb81022-d8a4-41f1-b089-491475a151c0" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" exitCode=0 Sep 18 13:05:49.081980 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.081976 2580 generic.go:356] "Generic (PLEG): container finished" podID="3fb81022-d8a4-41f1-b089-491475a151c0" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" exitCode=0 Sep 18 13:05:49.081980 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.081985 2580 generic.go:356] "Generic (PLEG): container finished" podID="3fb81022-d8a4-41f1-b089-491475a151c0" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" exitCode=0 Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.081991 2580 generic.go:356] "Generic (PLEG): container finished" podID="3fb81022-d8a4-41f1-b089-491475a151c0" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" exitCode=0 Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.081996 2580 generic.go:356] "Generic (PLEG): container finished" podID="3fb81022-d8a4-41f1-b089-491475a151c0" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" exitCode=0 Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082004 2580 generic.go:356] "Generic (PLEG): container finished" podID="3fb81022-d8a4-41f1-b089-491475a151c0" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" exitCode=0 Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082036 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082160 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082183 2580 scope.go:117] "RemoveContainer" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.082227 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} Sep 18 13:05:49.082592 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} Sep 18 13:05:49.082592 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082285 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} Sep 18 13:05:49.082592 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.082330 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fb81022-d8a4-41f1-b089-491475a151c0","Type":"ContainerDied","Data":"6bb1fc2d17e73f6e2ea8fc37ca728b858f163190eaa473a3f70e46bd58e810c1"} Sep 18 13:05:49.083416 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.083368 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" event={"ID":"bd6f3708-93d3-4a49-9b5d-905bdd831e31","Type":"ContainerStarted","Data":"0163b7b764e3dd59bd9496c1516899b73ad9d8fa9a159bc92ea7fde1431ff16d"} Sep 18 13:05:49.089369 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.089330 2580 scope.go:117] "RemoveContainer" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.096246 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.096227 2580 scope.go:117] "RemoveContainer" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.102660 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.102647 2580 scope.go:117] "RemoveContainer" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.108814 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.108798 2580 scope.go:117] "RemoveContainer" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.115155 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.115134 2580 scope.go:117] "RemoveContainer" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.115251 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.115189 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:05:49.121787 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.121765 2580 scope.go:117] "RemoveContainer" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.124864 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.124843 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:05:49.128142 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.128126 2580 scope.go:117] "RemoveContainer" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.128448 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:49.128430 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": container with ID starting with 2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068 not found: ID does not exist" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.128526 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.128460 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} err="failed to get container status \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": rpc error: code = NotFound desc = could not find container \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": container with ID starting with 2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068 not found: ID does not exist" Sep 18 13:05:49.128526 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.128495 2580 scope.go:117] "RemoveContainer" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.128768 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:49.128750 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": container with ID starting with 3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294 not found: ID does not exist" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.128808 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.128775 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} err="failed to get container status \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": rpc error: code = NotFound desc = could not find container \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": container with ID starting with 3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294 not found: ID does not exist" Sep 18 13:05:49.128808 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.128790 2580 scope.go:117] "RemoveContainer" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.129028 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:49.129007 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": container with ID starting with 82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3 not found: ID does not exist" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.129087 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129034 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} err="failed to get container status \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": rpc error: code = NotFound desc = could not find container \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": container with ID starting with 82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3 not found: ID does not exist" Sep 18 13:05:49.129087 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129049 2580 scope.go:117] "RemoveContainer" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.129276 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:49.129262 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": container with ID starting with 5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b not found: ID does not exist" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.129319 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129279 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} err="failed to get container status \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": rpc error: code = NotFound desc = could not find container \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": container with ID starting with 5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b not found: ID does not exist" Sep 18 13:05:49.129319 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129291 2580 scope.go:117] "RemoveContainer" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.129573 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:49.129557 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": container with ID starting with 82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6 not found: ID does not exist" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.129616 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129576 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} err="failed to get container status \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": rpc error: code = NotFound desc = could not find container \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": container with ID starting with 82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6 not found: ID does not exist" Sep 18 13:05:49.129616 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129592 2580 scope.go:117] "RemoveContainer" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.129843 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:49.129825 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": container with ID starting with 3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc not found: ID does not exist" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.129895 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129847 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} err="failed to get container status \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": rpc error: code = NotFound desc = could not find container \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": container with ID starting with 3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc not found: ID does not exist" Sep 18 13:05:49.129895 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.129860 2580 scope.go:117] "RemoveContainer" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.130100 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:05:49.130084 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": container with ID starting with 8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2 not found: ID does not exist" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.130135 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130103 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2"} err="failed to get container status \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": rpc error: code = NotFound desc = could not find container \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": container with ID starting with 8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2 not found: ID does not exist" Sep 18 13:05:49.130135 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130116 2580 scope.go:117] "RemoveContainer" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.130335 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130320 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} err="failed to get container status \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": rpc error: code = NotFound desc = could not find container \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": container with ID starting with 2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068 not found: ID does not exist" Sep 18 13:05:49.130335 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130334 2580 scope.go:117] "RemoveContainer" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.130577 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130561 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} err="failed to get container status \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": rpc error: code = NotFound desc = could not find container \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": container with ID starting with 3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294 not found: ID does not exist" Sep 18 13:05:49.130615 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130577 2580 scope.go:117] "RemoveContainer" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.130791 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130775 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} err="failed to get container status \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": rpc error: code = NotFound desc = could not find container \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": container with ID starting with 82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3 not found: ID does not exist" Sep 18 13:05:49.130842 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130793 2580 scope.go:117] "RemoveContainer" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.131001 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.130986 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} err="failed to get container status \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": rpc error: code = NotFound desc = could not find container \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": container with ID starting with 5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b not found: ID does not exist" Sep 18 13:05:49.131042 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131001 2580 scope.go:117] "RemoveContainer" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.131208 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131193 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} err="failed to get container status \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": rpc error: code = NotFound desc = could not find container \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": container with ID starting with 82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6 not found: ID does not exist" Sep 18 13:05:49.131250 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131207 2580 scope.go:117] "RemoveContainer" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.131452 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131435 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} err="failed to get container status \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": rpc error: code = NotFound desc = could not find container \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": container with ID starting with 3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc not found: ID does not exist" Sep 18 13:05:49.131499 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131453 2580 scope.go:117] "RemoveContainer" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.131656 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131640 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2"} err="failed to get container status \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": rpc error: code = NotFound desc = could not find container \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": container with ID starting with 8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2 not found: ID does not exist" Sep 18 13:05:49.131718 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131657 2580 scope.go:117] "RemoveContainer" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.131874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131855 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} err="failed to get container status \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": rpc error: code = NotFound desc = could not find container \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": container with ID starting with 2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068 not found: ID does not exist" Sep 18 13:05:49.131916 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.131875 2580 scope.go:117] "RemoveContainer" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.132117 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132098 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} err="failed to get container status \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": rpc error: code = NotFound desc = could not find container \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": container with ID starting with 3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294 not found: ID does not exist" Sep 18 13:05:49.132189 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132119 2580 scope.go:117] "RemoveContainer" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.132427 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132409 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} err="failed to get container status \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": rpc error: code = NotFound desc = could not find container \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": container with ID starting with 82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3 not found: ID does not exist" Sep 18 13:05:49.132494 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132428 2580 scope.go:117] "RemoveContainer" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.132665 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132647 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} err="failed to get container status \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": rpc error: code = NotFound desc = could not find container \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": container with ID starting with 5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b not found: ID does not exist" Sep 18 13:05:49.132705 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132666 2580 scope.go:117] "RemoveContainer" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.132899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132871 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} err="failed to get container status \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": rpc error: code = NotFound desc = could not find container \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": container with ID starting with 82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6 not found: ID does not exist" Sep 18 13:05:49.132941 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.132900 2580 scope.go:117] "RemoveContainer" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.133110 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133092 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} err="failed to get container status \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": rpc error: code = NotFound desc = could not find container \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": container with ID starting with 3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc not found: ID does not exist" Sep 18 13:05:49.133181 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133111 2580 scope.go:117] "RemoveContainer" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.133356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133339 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2"} err="failed to get container status \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": rpc error: code = NotFound desc = could not find container \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": container with ID starting with 8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2 not found: ID does not exist" Sep 18 13:05:49.133434 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133356 2580 scope.go:117] "RemoveContainer" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.133590 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133575 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} err="failed to get container status \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": rpc error: code = NotFound desc = could not find container \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": container with ID starting with 2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068 not found: ID does not exist" Sep 18 13:05:49.133630 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133590 2580 scope.go:117] "RemoveContainer" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.133811 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133793 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} err="failed to get container status \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": rpc error: code = NotFound desc = could not find container \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": container with ID starting with 3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294 not found: ID does not exist" Sep 18 13:05:49.133872 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.133813 2580 scope.go:117] "RemoveContainer" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.134018 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134003 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} err="failed to get container status \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": rpc error: code = NotFound desc = could not find container \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": container with ID starting with 82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3 not found: ID does not exist" Sep 18 13:05:49.134018 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134017 2580 scope.go:117] "RemoveContainer" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.134232 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134216 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} err="failed to get container status \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": rpc error: code = NotFound desc = could not find container \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": container with ID starting with 5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b not found: ID does not exist" Sep 18 13:05:49.134299 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134233 2580 scope.go:117] "RemoveContainer" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.134543 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134525 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} err="failed to get container status \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": rpc error: code = NotFound desc = could not find container \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": container with ID starting with 82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6 not found: ID does not exist" Sep 18 13:05:49.134594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134546 2580 scope.go:117] "RemoveContainer" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.134763 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134746 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} err="failed to get container status \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": rpc error: code = NotFound desc = could not find container \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": container with ID starting with 3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc not found: ID does not exist" Sep 18 13:05:49.134829 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134775 2580 scope.go:117] "RemoveContainer" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.135009 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.134992 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2"} err="failed to get container status \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": rpc error: code = NotFound desc = could not find container \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": container with ID starting with 8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2 not found: ID does not exist" Sep 18 13:05:49.135057 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135011 2580 scope.go:117] "RemoveContainer" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.135211 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135196 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} err="failed to get container status \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": rpc error: code = NotFound desc = could not find container \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": container with ID starting with 2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068 not found: ID does not exist" Sep 18 13:05:49.135255 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135211 2580 scope.go:117] "RemoveContainer" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.135425 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135406 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} err="failed to get container status \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": rpc error: code = NotFound desc = could not find container \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": container with ID starting with 3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294 not found: ID does not exist" Sep 18 13:05:49.135487 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135427 2580 scope.go:117] "RemoveContainer" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.135637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135621 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} err="failed to get container status \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": rpc error: code = NotFound desc = could not find container \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": container with ID starting with 82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3 not found: ID does not exist" Sep 18 13:05:49.135702 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135638 2580 scope.go:117] "RemoveContainer" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.135888 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135871 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} err="failed to get container status \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": rpc error: code = NotFound desc = could not find container \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": container with ID starting with 5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b not found: ID does not exist" Sep 18 13:05:49.135943 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.135890 2580 scope.go:117] "RemoveContainer" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.136093 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136077 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} err="failed to get container status \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": rpc error: code = NotFound desc = could not find container \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": container with ID starting with 82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6 not found: ID does not exist" Sep 18 13:05:49.136137 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136100 2580 scope.go:117] "RemoveContainer" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.136329 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136310 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} err="failed to get container status \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": rpc error: code = NotFound desc = could not find container \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": container with ID starting with 3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc not found: ID does not exist" Sep 18 13:05:49.136388 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136331 2580 scope.go:117] "RemoveContainer" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.136605 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136589 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2"} err="failed to get container status \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": rpc error: code = NotFound desc = could not find container \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": container with ID starting with 8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2 not found: ID does not exist" Sep 18 13:05:49.136676 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136606 2580 scope.go:117] "RemoveContainer" containerID="2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068" Sep 18 13:05:49.136838 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136813 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068"} err="failed to get container status \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": rpc error: code = NotFound desc = could not find container \"2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068\": container with ID starting with 2647f4512110b6b112f74e40ba252fde05f08495952c3d5ed37543f8ca2ab068 not found: ID does not exist" Sep 18 13:05:49.136886 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.136839 2580 scope.go:117] "RemoveContainer" containerID="3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294" Sep 18 13:05:49.137052 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137037 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294"} err="failed to get container status \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": rpc error: code = NotFound desc = could not find container \"3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294\": container with ID starting with 3bcf7433816acf5a8b67db8b5f0010544e267c44a41d431ce86c2faa094a1294 not found: ID does not exist" Sep 18 13:05:49.137095 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137052 2580 scope.go:117] "RemoveContainer" containerID="82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3" Sep 18 13:05:49.137259 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137241 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3"} err="failed to get container status \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": rpc error: code = NotFound desc = could not find container \"82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3\": container with ID starting with 82276def3d4f9019a5b6649b67a66fbb9d0899f38e7e150463e1e2929c14cfb3 not found: ID does not exist" Sep 18 13:05:49.137327 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137261 2580 scope.go:117] "RemoveContainer" containerID="5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b" Sep 18 13:05:49.137606 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137587 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b"} err="failed to get container status \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": rpc error: code = NotFound desc = could not find container \"5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b\": container with ID starting with 5dac211475384d3b9d32956a96202768d6cc9d363701fc1682429b6011b18b4b not found: ID does not exist" Sep 18 13:05:49.137606 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137605 2580 scope.go:117] "RemoveContainer" containerID="82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6" Sep 18 13:05:49.137812 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137793 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6"} err="failed to get container status \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": rpc error: code = NotFound desc = could not find container \"82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6\": container with ID starting with 82b2ca1ac498b38438d3bd4afea5017278bcab80660149a62e7022f377af9bf6 not found: ID does not exist" Sep 18 13:05:49.137878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.137814 2580 scope.go:117] "RemoveContainer" containerID="3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc" Sep 18 13:05:49.138052 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.138032 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc"} err="failed to get container status \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": rpc error: code = NotFound desc = could not find container \"3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc\": container with ID starting with 3db73c86cbddf7402024cd0f62580d5f42330b8070350c122a91116ee91e45cc not found: ID does not exist" Sep 18 13:05:49.138095 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.138053 2580 scope.go:117] "RemoveContainer" containerID="8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2" Sep 18 13:05:49.138255 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.138238 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2"} err="failed to get container status \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": rpc error: code = NotFound desc = could not find container \"8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2\": container with ID starting with 8a7d8d171ae85dc8ebc1b6e410ea5e1b2acdc63fb382d3c2811dc139caf796b2 not found: ID does not exist" Sep 18 13:05:49.174724 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174692 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:05:49.174925 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174914 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-thanos" Sep 18 13:05:49.174966 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174927 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-thanos" Sep 18 13:05:49.174966 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174939 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="thanos-sidecar" Sep 18 13:05:49.174966 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174945 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="thanos-sidecar" Sep 18 13:05:49.174966 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174951 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-web" Sep 18 13:05:49.174966 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174957 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-web" Sep 18 13:05:49.174966 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174964 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="init-config-reloader" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174969 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="init-config-reloader" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174975 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="config-reloader" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174980 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="config-reloader" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174988 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="prometheus" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.174993 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="prometheus" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175002 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175006 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175043 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="prometheus" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175051 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-web" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175058 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="thanos-sidecar" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175063 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175068 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="kube-rbac-proxy-thanos" Sep 18 13:05:49.175132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.175074 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" containerName="config-reloader" Sep 18 13:05:49.179801 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.179783 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.186058 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.186037 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 13:05:49.186416 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.186396 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b9tnvelqlo9n8\"" Sep 18 13:05:49.186554 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.186455 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 13:05:49.186554 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.186467 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 13:05:49.186554 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.186455 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 13:05:49.186554 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.186460 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 13:05:49.186839 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.186822 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5v4tp\"" Sep 18 13:05:49.187292 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187277 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 13:05:49.187393 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187306 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 13:05:49.187393 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187318 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 13:05:49.187498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187406 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 13:05:49.187498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187478 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 13:05:49.187593 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187577 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 13:05:49.187671 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187653 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 13:05:49.187744 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.187698 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 13:05:49.189020 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.189003 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 13:05:49.197649 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.197621 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 13:05:49.215428 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.215395 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:05:49.263638 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af11d09d-c86f-4c7a-97a3-9a92d6319f58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.263638 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af11d09d-c86f-4c7a-97a3-9a92d6319f58-config-out\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.263853 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.263853 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.263853 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.263962 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.263962 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.263962 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl9hw\" (UniqueName: \"kubernetes.io/projected/af11d09d-c86f-4c7a-97a3-9a92d6319f58-kube-api-access-sl9hw\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264072 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.263980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264072 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-web-config\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264072 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264072 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264226 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264226 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264226 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264226 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-config\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264282 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.264356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.264321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.365594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.365594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.365594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-config\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.365594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af11d09d-c86f-4c7a-97a3-9a92d6319f58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af11d09d-c86f-4c7a-97a3-9a92d6319f58-config-out\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.365994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl9hw\" (UniqueName: \"kubernetes.io/projected/af11d09d-c86f-4c7a-97a3-9a92d6319f58-kube-api-access-sl9hw\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-web-config\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366994 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366994 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366496 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.366994 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.366520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.367149 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.367096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.368631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.368759 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-config\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.368757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af11d09d-c86f-4c7a-97a3-9a92d6319f58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.368792 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369072 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369282 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-web-config\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.369558 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.370007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.370007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.369699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.371314 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.371289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af11d09d-c86f-4c7a-97a3-9a92d6319f58-config-out\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.371433 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.371410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.371481 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.371468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af11d09d-c86f-4c7a-97a3-9a92d6319f58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.371830 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.371813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af11d09d-c86f-4c7a-97a3-9a92d6319f58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.379336 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.379315 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl9hw\" (UniqueName: \"kubernetes.io/projected/af11d09d-c86f-4c7a-97a3-9a92d6319f58-kube-api-access-sl9hw\") pod \"prometheus-k8s-0\" (UID: \"af11d09d-c86f-4c7a-97a3-9a92d6319f58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.489426 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.489350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:05:49.787019 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:49.786944 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 13:05:49.789678 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:05:49.789651 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf11d09d_c86f_4c7a_97a3_9a92d6319f58.slice/crio-b7247697fd9105efebdc6a68d055cc8d20393bea66f8bd6ec8a7cb5461f51f32 WatchSource:0}: Error finding container b7247697fd9105efebdc6a68d055cc8d20393bea66f8bd6ec8a7cb5461f51f32: Status 404 returned error can't find the container with id b7247697fd9105efebdc6a68d055cc8d20393bea66f8bd6ec8a7cb5461f51f32 Sep 18 13:05:50.089945 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:50.089852 2580 generic.go:356] "Generic (PLEG): container finished" podID="af11d09d-c86f-4c7a-97a3-9a92d6319f58" containerID="38e861bfbf92a39ae6aac117a3c1655a88040297ebfabe25cc0f15bee55d23e1" exitCode=0 Sep 18 13:05:50.089945 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:50.089898 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerDied","Data":"38e861bfbf92a39ae6aac117a3c1655a88040297ebfabe25cc0f15bee55d23e1"} Sep 18 13:05:50.090137 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:50.089959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerStarted","Data":"b7247697fd9105efebdc6a68d055cc8d20393bea66f8bd6ec8a7cb5461f51f32"} Sep 18 13:05:50.372360 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:50.372330 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb81022-d8a4-41f1-b089-491475a151c0" path="/var/lib/kubelet/pods/3fb81022-d8a4-41f1-b089-491475a151c0/volumes" Sep 18 13:05:51.095231 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.095159 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" event={"ID":"bd6f3708-93d3-4a49-9b5d-905bdd831e31","Type":"ContainerStarted","Data":"22bd9311860022c30271efea3f8efa48ba30f7691a6e044ee21409a3fb463c85"} Sep 18 13:05:51.095231 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.095220 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" event={"ID":"bd6f3708-93d3-4a49-9b5d-905bdd831e31","Type":"ContainerStarted","Data":"b94912a341076048be4ec0ca2beef1e07e2bfdcf9c2098dc65eada6e1bf9400e"} Sep 18 13:05:51.095400 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.095249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" event={"ID":"bd6f3708-93d3-4a49-9b5d-905bdd831e31","Type":"ContainerStarted","Data":"ac136d69fc92367ff6b9642340d32b959951baae5dfebaa75a7b9c29ec5fa753"} Sep 18 13:05:51.099058 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.099035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerStarted","Data":"e81d945a536a12d8e042686966ad13dfcb762655fb60741ea3aa4b38fe2f7eba"} Sep 18 13:05:51.099220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.099087 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerStarted","Data":"42c176623c28c52e76e1af8eae8b0d8b2d8a7cfe1bfa1d9775176f5b6b524901"} Sep 18 13:05:51.099220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.099113 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerStarted","Data":"cc5b68b9fe3dcea8f9d6559efb59071882846dd017861bf54b6abc941108ca44"} Sep 18 13:05:51.099220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.099136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerStarted","Data":"8a646d5cad3d74fa697199f225977b2c88904b9fd95e03eca9f8273af8cf1af9"} Sep 18 13:05:51.099220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.099158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerStarted","Data":"cf1fa73df19462884005d3e140ff199f2610f31f7bc9d36e1e1593ca63f23533"} Sep 18 13:05:51.099220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.099182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af11d09d-c86f-4c7a-97a3-9a92d6319f58","Type":"ContainerStarted","Data":"6ac85a5527970654af00c2fbeedf82de4d1ed81ca773debaf1d12087d8125604"} Sep 18 13:05:51.128042 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.127990 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cf599d4bd-vfwsm" podStartSLOduration=1.114884232 podStartE2EDuration="3.127971095s" totalImagesPullingTime="2.013086863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:05:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:05:51.124951155 +0000 UTC m=+215.262425116" watchObservedRunningTime="2026-09-18 13:05:51.127971095 +0000 UTC m=+215.265445062" Sep 18 13:05:51.181600 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.181557 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.155587965 podStartE2EDuration="2.181543244s" totalImagesPullingTime="0s" totalInitContainerRuntime="25.955279ms" isStatefulPod=false podCreationTimestamp="2026-09-18 13:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:05:51.179181534 +0000 UTC m=+215.316655501" watchObservedRunningTime="2026-09-18 13:05:51.181543244 +0000 UTC m=+215.319017233" Sep 18 13:05:51.273755 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.273723 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9c6d86fbf-g8l8z"] Sep 18 13:05:51.276875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.276860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.307063 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.307032 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c6d86fbf-g8l8z"] Sep 18 13:05:51.351002 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.350908 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:51.385766 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.385735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-console-config\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.386094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.385769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-serving-cert\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.386094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.385868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mrf9\" (UniqueName: \"kubernetes.io/projected/ddd914d4-977f-4f49-956d-f51322992ee7-kube-api-access-7mrf9\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.386094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.385894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-service-ca\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.386094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.385916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-trusted-ca-bundle\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.386094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.385988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-oauth-serving-cert\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.386094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.386066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-oauth-config\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.486570 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.486529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-oauth-serving-cert\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.486740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.486597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-oauth-config\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.486740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.486620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-console-config\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.486740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.486641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-serving-cert\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.486740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.486656 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mrf9\" (UniqueName: \"kubernetes.io/projected/ddd914d4-977f-4f49-956d-f51322992ee7-kube-api-access-7mrf9\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.486740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.486676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-service-ca\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.486740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.486701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-trusted-ca-bundle\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.487439 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.487409 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-oauth-serving-cert\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.487539 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.487409 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-console-config\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.487584 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.487558 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-service-ca\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.487619 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.487596 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-trusted-ca-bundle\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.489202 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.489182 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-oauth-config\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.489254 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.489240 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-serving-cert\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.496509 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.496460 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mrf9\" (UniqueName: \"kubernetes.io/projected/ddd914d4-977f-4f49-956d-f51322992ee7-kube-api-access-7mrf9\") pod \"console-9c6d86fbf-g8l8z\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.556027 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.555995 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:05:51.585698 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.585654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:05:51.865443 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:51.865409 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c6d86fbf-g8l8z"] Sep 18 13:05:51.868601 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:05:51.868577 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd914d4_977f_4f49_956d_f51322992ee7.slice/crio-02f719fa0e329aa41b1e1eca1241dbf86706d2c46cf54aae41676a14b6cbe3e8 WatchSource:0}: Error finding container 02f719fa0e329aa41b1e1eca1241dbf86706d2c46cf54aae41676a14b6cbe3e8: Status 404 returned error can't find the container with id 02f719fa0e329aa41b1e1eca1241dbf86706d2c46cf54aae41676a14b6cbe3e8 Sep 18 13:05:52.104655 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:52.104613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c6d86fbf-g8l8z" event={"ID":"ddd914d4-977f-4f49-956d-f51322992ee7","Type":"ContainerStarted","Data":"41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f"} Sep 18 13:05:52.104852 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:52.104669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c6d86fbf-g8l8z" event={"ID":"ddd914d4-977f-4f49-956d-f51322992ee7","Type":"ContainerStarted","Data":"02f719fa0e329aa41b1e1eca1241dbf86706d2c46cf54aae41676a14b6cbe3e8"} Sep 18 13:05:52.139125 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:52.139021 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9c6d86fbf-g8l8z" podStartSLOduration=1.139004566 podStartE2EDuration="1.139004566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:05:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:05:52.137526962 +0000 UTC m=+216.275000928" watchObservedRunningTime="2026-09-18 13:05:52.139004566 +0000 UTC m=+216.276478533" Sep 18 13:05:54.489773 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:05:54.489720 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:06:01.586623 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:01.586584 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:06:01.587032 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:01.586637 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:06:01.591241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:01.591218 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:06:02.142501 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:02.142471 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:06:02.219728 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:02.219698 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7498647c79-bkmmb"] Sep 18 13:06:02.452223 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:02.452189 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:06:02.579385 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:02.579354 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:06:05.240850 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:05.240810 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:06:27.237634 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.237578 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7498647c79-bkmmb" podUID="b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" containerName="console" containerID="cri-o://ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1" gracePeriod=15 Sep 18 13:06:27.485032 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.485010 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:06:27.590353 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590261 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-oauth-serving-cert\") pod \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " Sep 18 13:06:27.590353 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590313 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-serving-cert\") pod \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " Sep 18 13:06:27.590353 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590339 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctmst\" (UniqueName: \"kubernetes.io/projected/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-kube-api-access-ctmst\") pod \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " Sep 18 13:06:27.590652 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590357 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-service-ca\") pod \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " Sep 18 13:06:27.590652 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590396 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-trusted-ca-bundle\") pod \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " Sep 18 13:06:27.590652 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590419 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-config\") pod \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " Sep 18 13:06:27.590652 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590582 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-oauth-config\") pod \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\" (UID: \"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9\") " Sep 18 13:06:27.590864 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590810 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" (UID: "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:06:27.590864 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590810 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" (UID: "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:06:27.590960 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.590890 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-config" (OuterVolumeSpecName: "console-config") pod "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" (UID: "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:06:27.591082 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.591059 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" (UID: "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:06:27.592588 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.592560 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" (UID: "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:06:27.592691 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.592638 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-kube-api-access-ctmst" (OuterVolumeSpecName: "kube-api-access-ctmst") pod "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" (UID: "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9"). InnerVolumeSpecName "kube-api-access-ctmst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:06:27.592691 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.592662 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" (UID: "b6ce4cc1-c492-40f1-9ec5-065516a5fbc9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:06:27.691289 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.691259 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-trusted-ca-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:06:27.691289 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.691281 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:06:27.691289 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.691290 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-oauth-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:06:27.691289 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.691298 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-oauth-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:06:27.691528 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.691306 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-console-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:06:27.691528 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.691315 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctmst\" (UniqueName: \"kubernetes.io/projected/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-kube-api-access-ctmst\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:06:27.691528 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:27.691323 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9-service-ca\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:06:28.093563 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.093512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:06:28.096156 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.096137 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 13:06:28.105807 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.105776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2fbfeb-7084-4c33-a604-24123f4420e9-metrics-certs\") pod \"network-metrics-daemon-hwp4v\" (UID: \"fa2fbfeb-7084-4c33-a604-24123f4420e9\") " pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:06:28.194709 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.194672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:06:28.194809 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.194777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:06:28.197866 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.197849 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 13:06:28.197925 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.197895 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 13:06:28.207187 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.207167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84-original-pull-secret\") pod \"global-pull-secret-syncer-xk4hx\" (UID: \"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84\") " pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:06:28.208160 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.208146 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 13:06:28.217750 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.217730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62k98\" (UniqueName: \"kubernetes.io/projected/11edae4f-2d74-48d5-a5e9-84027db1dae2-kube-api-access-62k98\") pod \"network-check-target-gl64v\" (UID: \"11edae4f-2d74-48d5-a5e9-84027db1dae2\") " pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:06:28.223527 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.223500 2580 generic.go:356] "Generic (PLEG): container finished" podID="b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" containerID="ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1" exitCode=0 Sep 18 13:06:28.223620 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.223540 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7498647c79-bkmmb" Sep 18 13:06:28.223620 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.223553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7498647c79-bkmmb" event={"ID":"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9","Type":"ContainerDied","Data":"ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1"} Sep 18 13:06:28.223620 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.223599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7498647c79-bkmmb" event={"ID":"b6ce4cc1-c492-40f1-9ec5-065516a5fbc9","Type":"ContainerDied","Data":"6730a2df3e084f84c66bec06740a11db69ff8752ad885f912552e2d1d2b0e52d"} Sep 18 13:06:28.223620 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.223620 2580 scope.go:117] "RemoveContainer" containerID="ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1" Sep 18 13:06:28.231741 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.231726 2580 scope.go:117] "RemoveContainer" containerID="ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1" Sep 18 13:06:28.232046 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:06:28.232018 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1\": container with ID starting with ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1 not found: ID does not exist" containerID="ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1" Sep 18 13:06:28.232149 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.232053 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1"} err="failed to get container status \"ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1\": rpc error: code = NotFound desc = could not find container \"ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1\": container with ID starting with ad9f81809de1bcd55301565dafdb191e64c709a57d44e2c901817e8c2f0e09e1 not found: ID does not exist" Sep 18 13:06:28.245879 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.245855 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7498647c79-bkmmb"] Sep 18 13:06:28.250758 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.250737 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7498647c79-bkmmb"] Sep 18 13:06:28.275818 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.275786 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xk4hx" Sep 18 13:06:28.283478 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.283456 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2m78j\"" Sep 18 13:06:28.287690 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.287672 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npxzw\"" Sep 18 13:06:28.291804 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.291787 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:06:28.295681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.295661 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hwp4v" Sep 18 13:06:28.372842 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.371713 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" path="/var/lib/kubelet/pods/b6ce4cc1-c492-40f1-9ec5-065516a5fbc9/volumes" Sep 18 13:06:28.545239 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.545209 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xk4hx"] Sep 18 13:06:28.548086 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:06:28.548055 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5ceb81_c3da_43c5_ab32_1f4c9bdd6c84.slice/crio-8ca7ec1c5b3d9d2cdf12c64a8b156e270810d110241e463c511d627977d13fea WatchSource:0}: Error finding container 8ca7ec1c5b3d9d2cdf12c64a8b156e270810d110241e463c511d627977d13fea: Status 404 returned error can't find the container with id 8ca7ec1c5b3d9d2cdf12c64a8b156e270810d110241e463c511d627977d13fea Sep 18 13:06:28.570413 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.570367 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gl64v"] Sep 18 13:06:28.573276 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:06:28.573251 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11edae4f_2d74_48d5_a5e9_84027db1dae2.slice/crio-06b2b52c66d275aadb613b4b20f550739be8a33eaf65fd2ecc85854765813267 WatchSource:0}: Error finding container 06b2b52c66d275aadb613b4b20f550739be8a33eaf65fd2ecc85854765813267: Status 404 returned error can't find the container with id 06b2b52c66d275aadb613b4b20f550739be8a33eaf65fd2ecc85854765813267 Sep 18 13:06:28.577706 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:28.577687 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hwp4v"] Sep 18 13:06:28.579815 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:06:28.579791 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2fbfeb_7084_4c33_a604_24123f4420e9.slice/crio-5fd1f5f921cc7bd85f04dec32af733d16f471f0c14d125d4addada7b4fe93ae7 WatchSource:0}: Error finding container 5fd1f5f921cc7bd85f04dec32af733d16f471f0c14d125d4addada7b4fe93ae7: Status 404 returned error can't find the container with id 5fd1f5f921cc7bd85f04dec32af733d16f471f0c14d125d4addada7b4fe93ae7 Sep 18 13:06:29.231969 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:29.231890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hwp4v" event={"ID":"fa2fbfeb-7084-4c33-a604-24123f4420e9","Type":"ContainerStarted","Data":"5fd1f5f921cc7bd85f04dec32af733d16f471f0c14d125d4addada7b4fe93ae7"} Sep 18 13:06:29.233553 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:29.233511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gl64v" event={"ID":"11edae4f-2d74-48d5-a5e9-84027db1dae2","Type":"ContainerStarted","Data":"06b2b52c66d275aadb613b4b20f550739be8a33eaf65fd2ecc85854765813267"} Sep 18 13:06:29.235264 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:29.235206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xk4hx" event={"ID":"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84","Type":"ContainerStarted","Data":"8ca7ec1c5b3d9d2cdf12c64a8b156e270810d110241e463c511d627977d13fea"} Sep 18 13:06:30.243042 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:30.243002 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hwp4v" event={"ID":"fa2fbfeb-7084-4c33-a604-24123f4420e9","Type":"ContainerStarted","Data":"63bd99cea2ffb351b809b3ebb25331ab46691302ad6637ea7683f0d1e8e3d860"} Sep 18 13:06:30.243529 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:30.243069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hwp4v" event={"ID":"fa2fbfeb-7084-4c33-a604-24123f4420e9","Type":"ContainerStarted","Data":"bafcccd02f8e6cb87b928f1ac68df25a0c7231d84235aaddfc0757778aa4556d"} Sep 18 13:06:30.260675 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:30.260618 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hwp4v" podStartSLOduration=253.013096483 podStartE2EDuration="4m14.260596452s" totalImagesPullingTime="1.247499969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:06:30.258728517 +0000 UTC m=+254.396202487" watchObservedRunningTime="2026-09-18 13:06:30.260596452 +0000 UTC m=+254.398070422" Sep 18 13:06:30.354115 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:30.354077 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:06:31.613565 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:31.613517 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:06:33.258623 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:33.258576 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gl64v" event={"ID":"11edae4f-2d74-48d5-a5e9-84027db1dae2","Type":"ContainerStarted","Data":"1390479f3ca5b3b03ad196e7ee1cfc5938436cf739f0097c0efdba5989af0fd0"} Sep 18 13:06:33.259112 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:33.258715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:06:33.260133 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:33.260108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xk4hx" event={"ID":"7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84","Type":"ContainerStarted","Data":"c2be2dc056ba9dbc03f120b3b28d2b863ca3e9bc1f7e4beb9e46743acbb36777"} Sep 18 13:06:33.274514 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:33.274473 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gl64v" podStartSLOduration=252.734261593 podStartE2EDuration="4m17.274459072s" totalImagesPullingTime="4.540197479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:06:33.274236599 +0000 UTC m=+257.411710567" watchObservedRunningTime="2026-09-18 13:06:33.274459072 +0000 UTC m=+257.411933039" Sep 18 13:06:49.489850 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:49.489760 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:06:49.504719 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:49.504688 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:06:49.534598 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:49.534544 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xk4hx" podStartSLOduration=267.965315135 podStartE2EDuration="4m32.534528102s" totalImagesPullingTime="4.569212967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:06:33.290272463 +0000 UTC m=+257.427746431" watchObservedRunningTime="2026-09-18 13:06:49.534528102 +0000 UTC m=+273.672002070" Sep 18 13:06:50.333882 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:50.333856 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 13:06:58.476656 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:58.476612 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:06:58.541004 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:06:58.540974 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:03.832889 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:03.832857 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:04.266431 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:04.266403 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gl64v" Sep 18 13:07:10.403823 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:10.403791 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:10.468277 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:10.468239 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:15.048458 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:15.048414 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:15.107606 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:15.107579 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:16.226526 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:16.226496 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:07:16.230584 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:16.230561 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:07:16.231598 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:16.231578 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:07:16.232948 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:16.232932 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 13:07:16.235828 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:16.235812 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:07:21.112449 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:21.112392 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:21.211455 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:21.211425 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:34.139303 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.139264 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-749dcc69f7-vm48d"] Sep 18 13:07:34.139781 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.139596 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" containerName="console" Sep 18 13:07:34.139781 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.139611 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" containerName="console" Sep 18 13:07:34.139781 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.139652 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ce4cc1-c492-40f1-9ec5-065516a5fbc9" containerName="console" Sep 18 13:07:34.141482 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.141465 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.166735 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.166712 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749dcc69f7-vm48d"] Sep 18 13:07:34.273866 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.273833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-oauth-config\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.273866 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.273873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-console-config\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.274076 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.273895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwl7n\" (UniqueName: \"kubernetes.io/projected/aaf41c00-d921-4ef3-b880-954878650d30-kube-api-access-rwl7n\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.274076 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.273992 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-oauth-serving-cert\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.274076 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.274019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-trusted-ca-bundle\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.274076 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.274040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-serving-cert\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.274217 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.274102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-service-ca\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.308285 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.308249 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:34.374928 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.374894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwl7n\" (UniqueName: \"kubernetes.io/projected/aaf41c00-d921-4ef3-b880-954878650d30-kube-api-access-rwl7n\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375065 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.374953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-oauth-serving-cert\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375065 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.374970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-trusted-ca-bundle\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375065 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.374987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-serving-cert\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375065 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.375020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-service-ca\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375262 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.375136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-oauth-config\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375262 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.375198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-console-config\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375760 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.375737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-service-ca\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375870 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.375738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-oauth-serving-cert\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375913 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.375873 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-console-config\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.375913 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.375892 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-trusted-ca-bundle\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.377530 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.377513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-serving-cert\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.377725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.377705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-oauth-config\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.395035 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.394986 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwl7n\" (UniqueName: \"kubernetes.io/projected/aaf41c00-d921-4ef3-b880-954878650d30-kube-api-access-rwl7n\") pod \"console-749dcc69f7-vm48d\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.450062 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.450018 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:34.480737 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.480703 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:34.720643 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:34.720604 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749dcc69f7-vm48d"] Sep 18 13:07:34.723415 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:07:34.723388 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf41c00_d921_4ef3_b880_954878650d30.slice/crio-ff41958787466075385d4f53e01dc8a4b9fb4e13e3c1de461a8d244cf772c1b9 WatchSource:0}: Error finding container ff41958787466075385d4f53e01dc8a4b9fb4e13e3c1de461a8d244cf772c1b9: Status 404 returned error can't find the container with id ff41958787466075385d4f53e01dc8a4b9fb4e13e3c1de461a8d244cf772c1b9 Sep 18 13:07:35.470877 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:35.470838 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749dcc69f7-vm48d" event={"ID":"aaf41c00-d921-4ef3-b880-954878650d30","Type":"ContainerStarted","Data":"3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef"} Sep 18 13:07:35.471357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:35.470889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749dcc69f7-vm48d" event={"ID":"aaf41c00-d921-4ef3-b880-954878650d30","Type":"ContainerStarted","Data":"ff41958787466075385d4f53e01dc8a4b9fb4e13e3c1de461a8d244cf772c1b9"} Sep 18 13:07:35.488788 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:35.488737 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-749dcc69f7-vm48d" podStartSLOduration=1.4887227250000001 podStartE2EDuration="1.488722725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:07:35.487586636 +0000 UTC m=+319.625060606" watchObservedRunningTime="2026-09-18 13:07:35.488722725 +0000 UTC m=+319.626196692" Sep 18 13:07:44.450239 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.450201 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:44.450782 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.450266 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:44.454848 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.454822 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:44.507453 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.507429 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:07:44.559706 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.559670 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c6d86fbf-g8l8z"] Sep 18 13:07:44.669023 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.668998 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:44.768825 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.768738 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:44.833861 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:44.833832 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:07:59.943761 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:07:59.943729 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:00.085555 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:00.085519 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:01.099638 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.099602 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv"] Sep 18 13:08:01.102073 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.102054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.105839 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.105818 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 13:08:01.106053 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.106039 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jvjx5\"" Sep 18 13:08:01.106158 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.106136 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 13:08:01.122726 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.122703 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv"] Sep 18 13:08:01.274278 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.274244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.274278 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.274284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.274526 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.274324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5ds\" (UniqueName: \"kubernetes.io/projected/d114289d-aca8-41da-a837-f1500b330594-kube-api-access-gj5ds\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.375255 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.375162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.375255 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.375204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.375255 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.375239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5ds\" (UniqueName: \"kubernetes.io/projected/d114289d-aca8-41da-a837-f1500b330594-kube-api-access-gj5ds\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.375595 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.375572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.375636 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.375600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.392189 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.392165 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5ds\" (UniqueName: \"kubernetes.io/projected/d114289d-aca8-41da-a837-f1500b330594-kube-api-access-gj5ds\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.411146 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.411124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:01.724821 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.724794 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv"] Sep 18 13:08:01.727242 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:01.727214 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd114289d_aca8_41da_a837_f1500b330594.slice/crio-e91e2752777c7e302a018c19beb726a2fd947574865ea69f9e060de50652bbf5 WatchSource:0}: Error finding container e91e2752777c7e302a018c19beb726a2fd947574865ea69f9e060de50652bbf5: Status 404 returned error can't find the container with id e91e2752777c7e302a018c19beb726a2fd947574865ea69f9e060de50652bbf5 Sep 18 13:08:01.729232 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:01.729216 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:08:02.569587 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:02.569543 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" event={"ID":"d114289d-aca8-41da-a837-f1500b330594","Type":"ContainerStarted","Data":"e91e2752777c7e302a018c19beb726a2fd947574865ea69f9e060de50652bbf5"} Sep 18 13:08:07.590788 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:07.590747 2580 generic.go:356] "Generic (PLEG): container finished" podID="d114289d-aca8-41da-a837-f1500b330594" containerID="cb54ff148d55346f4523fdf4018e55c7154d9b89c0af29b8052a0e8094b72d78" exitCode=0 Sep 18 13:08:07.591287 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:07.590796 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" event={"ID":"d114289d-aca8-41da-a837-f1500b330594","Type":"ContainerDied","Data":"cb54ff148d55346f4523fdf4018e55c7154d9b89c0af29b8052a0e8094b72d78"} Sep 18 13:08:09.582229 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:09.582148 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9c6d86fbf-g8l8z" podUID="ddd914d4-977f-4f49-956d-f51322992ee7" containerName="console" containerID="cri-o://41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f" gracePeriod=15 Sep 18 13:08:09.864862 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:09.864834 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:08:10.051700 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.051659 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-service-ca\") pod \"ddd914d4-977f-4f49-956d-f51322992ee7\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " Sep 18 13:08:10.051700 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.051697 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-trusted-ca-bundle\") pod \"ddd914d4-977f-4f49-956d-f51322992ee7\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " Sep 18 13:08:10.051931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.051720 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-oauth-config\") pod \"ddd914d4-977f-4f49-956d-f51322992ee7\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " Sep 18 13:08:10.051931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.051754 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-oauth-serving-cert\") pod \"ddd914d4-977f-4f49-956d-f51322992ee7\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " Sep 18 13:08:10.051931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.051808 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-serving-cert\") pod \"ddd914d4-977f-4f49-956d-f51322992ee7\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " Sep 18 13:08:10.051931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.051850 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-console-config\") pod \"ddd914d4-977f-4f49-956d-f51322992ee7\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " Sep 18 13:08:10.051931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.051879 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mrf9\" (UniqueName: \"kubernetes.io/projected/ddd914d4-977f-4f49-956d-f51322992ee7-kube-api-access-7mrf9\") pod \"ddd914d4-977f-4f49-956d-f51322992ee7\" (UID: \"ddd914d4-977f-4f49-956d-f51322992ee7\") " Sep 18 13:08:10.052181 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.052118 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ddd914d4-977f-4f49-956d-f51322992ee7" (UID: "ddd914d4-977f-4f49-956d-f51322992ee7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:08:10.052335 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.052309 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ddd914d4-977f-4f49-956d-f51322992ee7" (UID: "ddd914d4-977f-4f49-956d-f51322992ee7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:08:10.052426 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.052330 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ddd914d4-977f-4f49-956d-f51322992ee7" (UID: "ddd914d4-977f-4f49-956d-f51322992ee7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:08:10.052495 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.052446 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-console-config" (OuterVolumeSpecName: "console-config") pod "ddd914d4-977f-4f49-956d-f51322992ee7" (UID: "ddd914d4-977f-4f49-956d-f51322992ee7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:08:10.054017 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.053987 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ddd914d4-977f-4f49-956d-f51322992ee7" (UID: "ddd914d4-977f-4f49-956d-f51322992ee7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:08:10.054126 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.054019 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd914d4-977f-4f49-956d-f51322992ee7-kube-api-access-7mrf9" (OuterVolumeSpecName: "kube-api-access-7mrf9") pod "ddd914d4-977f-4f49-956d-f51322992ee7" (UID: "ddd914d4-977f-4f49-956d-f51322992ee7"). InnerVolumeSpecName "kube-api-access-7mrf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:08:10.054126 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.054050 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ddd914d4-977f-4f49-956d-f51322992ee7" (UID: "ddd914d4-977f-4f49-956d-f51322992ee7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:08:10.153056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.152984 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-oauth-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:10.153056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.153012 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:10.153056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.153021 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-console-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:10.153056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.153030 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mrf9\" (UniqueName: \"kubernetes.io/projected/ddd914d4-977f-4f49-956d-f51322992ee7-kube-api-access-7mrf9\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:10.153056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.153039 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-service-ca\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:10.153056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.153047 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd914d4-977f-4f49-956d-f51322992ee7-trusted-ca-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:10.153056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.153054 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd914d4-977f-4f49-956d-f51322992ee7-console-oauth-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:10.604427 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.604367 2580 generic.go:356] "Generic (PLEG): container finished" podID="d114289d-aca8-41da-a837-f1500b330594" containerID="b02f2aaf332c6eeed76dc7bedd224b2f345a751f03912ef1d48ac07d3ce974db" exitCode=0 Sep 18 13:08:10.604427 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.604414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" event={"ID":"d114289d-aca8-41da-a837-f1500b330594","Type":"ContainerDied","Data":"b02f2aaf332c6eeed76dc7bedd224b2f345a751f03912ef1d48ac07d3ce974db"} Sep 18 13:08:10.605813 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.605791 2580 generic.go:356] "Generic (PLEG): container finished" podID="ddd914d4-977f-4f49-956d-f51322992ee7" containerID="41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f" exitCode=0 Sep 18 13:08:10.605890 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.605817 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c6d86fbf-g8l8z" Sep 18 13:08:10.605890 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.605832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c6d86fbf-g8l8z" event={"ID":"ddd914d4-977f-4f49-956d-f51322992ee7","Type":"ContainerDied","Data":"41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f"} Sep 18 13:08:10.605890 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.605874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c6d86fbf-g8l8z" event={"ID":"ddd914d4-977f-4f49-956d-f51322992ee7","Type":"ContainerDied","Data":"02f719fa0e329aa41b1e1eca1241dbf86706d2c46cf54aae41676a14b6cbe3e8"} Sep 18 13:08:10.605995 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.605896 2580 scope.go:117] "RemoveContainer" containerID="41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f" Sep 18 13:08:10.613830 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.613809 2580 scope.go:117] "RemoveContainer" containerID="41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f" Sep 18 13:08:10.614096 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:08:10.614077 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f\": container with ID starting with 41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f not found: ID does not exist" containerID="41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f" Sep 18 13:08:10.614140 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.614104 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f"} err="failed to get container status \"41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f\": rpc error: code = NotFound desc = could not find container \"41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f\": container with ID starting with 41d20c568a0567000e2a74bdd125d60df96c594fda10e118f74b7206867b921f not found: ID does not exist" Sep 18 13:08:10.633444 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.633420 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c6d86fbf-g8l8z"] Sep 18 13:08:10.636740 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:10.636720 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9c6d86fbf-g8l8z"] Sep 18 13:08:12.370166 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:12.370135 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddd914d4-977f-4f49-956d-f51322992ee7" path="/var/lib/kubelet/pods/ddd914d4-977f-4f49-956d-f51322992ee7/volumes" Sep 18 13:08:17.635556 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:17.635474 2580 generic.go:356] "Generic (PLEG): container finished" podID="d114289d-aca8-41da-a837-f1500b330594" containerID="02fa2d0fba6a2344d9854033347a7d374fcb31043c2abe8fcc67b43b9ae2ea6a" exitCode=0 Sep 18 13:08:17.635556 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:17.635533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" event={"ID":"d114289d-aca8-41da-a837-f1500b330594","Type":"ContainerDied","Data":"02fa2d0fba6a2344d9854033347a7d374fcb31043c2abe8fcc67b43b9ae2ea6a"} Sep 18 13:08:18.784368 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.784340 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:18.818199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.818172 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-bundle\") pod \"d114289d-aca8-41da-a837-f1500b330594\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " Sep 18 13:08:18.818344 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.818213 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-util\") pod \"d114289d-aca8-41da-a837-f1500b330594\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " Sep 18 13:08:18.818344 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.818244 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj5ds\" (UniqueName: \"kubernetes.io/projected/d114289d-aca8-41da-a837-f1500b330594-kube-api-access-gj5ds\") pod \"d114289d-aca8-41da-a837-f1500b330594\" (UID: \"d114289d-aca8-41da-a837-f1500b330594\") " Sep 18 13:08:18.818937 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.818909 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-bundle" (OuterVolumeSpecName: "bundle") pod "d114289d-aca8-41da-a837-f1500b330594" (UID: "d114289d-aca8-41da-a837-f1500b330594"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:08:18.820310 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.820293 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d114289d-aca8-41da-a837-f1500b330594-kube-api-access-gj5ds" (OuterVolumeSpecName: "kube-api-access-gj5ds") pod "d114289d-aca8-41da-a837-f1500b330594" (UID: "d114289d-aca8-41da-a837-f1500b330594"). InnerVolumeSpecName "kube-api-access-gj5ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:08:18.822523 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.822500 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-util" (OuterVolumeSpecName: "util") pod "d114289d-aca8-41da-a837-f1500b330594" (UID: "d114289d-aca8-41da-a837-f1500b330594"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:08:18.919152 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.919074 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:18.919152 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.919104 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d114289d-aca8-41da-a837-f1500b330594-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:18.919152 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:18.919117 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj5ds\" (UniqueName: \"kubernetes.io/projected/d114289d-aca8-41da-a837-f1500b330594-kube-api-access-gj5ds\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:19.644343 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:19.644308 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" event={"ID":"d114289d-aca8-41da-a837-f1500b330594","Type":"ContainerDied","Data":"e91e2752777c7e302a018c19beb726a2fd947574865ea69f9e060de50652bbf5"} Sep 18 13:08:19.644517 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:19.644358 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e91e2752777c7e302a018c19beb726a2fd947574865ea69f9e060de50652bbf5" Sep 18 13:08:19.644517 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:19.644318 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frvrv" Sep 18 13:08:22.370018 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:22.369985 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:23.739446 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:23.739411 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:24.321582 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321549 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg"] Sep 18 13:08:24.321861 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321846 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d114289d-aca8-41da-a837-f1500b330594" containerName="util" Sep 18 13:08:24.321951 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321866 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d114289d-aca8-41da-a837-f1500b330594" containerName="util" Sep 18 13:08:24.321951 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321878 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd914d4-977f-4f49-956d-f51322992ee7" containerName="console" Sep 18 13:08:24.321951 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321885 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd914d4-977f-4f49-956d-f51322992ee7" containerName="console" Sep 18 13:08:24.321951 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321913 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d114289d-aca8-41da-a837-f1500b330594" containerName="pull" Sep 18 13:08:24.321951 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321921 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d114289d-aca8-41da-a837-f1500b330594" containerName="pull" Sep 18 13:08:24.321951 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321932 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d114289d-aca8-41da-a837-f1500b330594" containerName="extract" Sep 18 13:08:24.321951 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321940 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d114289d-aca8-41da-a837-f1500b330594" containerName="extract" Sep 18 13:08:24.322270 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.321997 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddd914d4-977f-4f49-956d-f51322992ee7" containerName="console" Sep 18 13:08:24.322270 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.322009 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d114289d-aca8-41da-a837-f1500b330594" containerName="extract" Sep 18 13:08:24.324775 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.324755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.327531 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.327506 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 18 13:08:24.327796 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.327778 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-prwnk\"" Sep 18 13:08:24.327885 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.327865 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:08:24.341940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.341916 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg"] Sep 18 13:08:24.354015 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.353978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dslxt\" (UniqueName: \"kubernetes.io/projected/38278dd7-d4f6-4301-a000-241dd1b54cf5-kube-api-access-dslxt\") pod \"cert-manager-operator-controller-manager-55c444bf86-tb2cg\" (UID: \"38278dd7-d4f6-4301-a000-241dd1b54cf5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.354015 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.354020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38278dd7-d4f6-4301-a000-241dd1b54cf5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tb2cg\" (UID: \"38278dd7-d4f6-4301-a000-241dd1b54cf5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.454527 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.454489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dslxt\" (UniqueName: \"kubernetes.io/projected/38278dd7-d4f6-4301-a000-241dd1b54cf5-kube-api-access-dslxt\") pod \"cert-manager-operator-controller-manager-55c444bf86-tb2cg\" (UID: \"38278dd7-d4f6-4301-a000-241dd1b54cf5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.454527 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.454532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38278dd7-d4f6-4301-a000-241dd1b54cf5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tb2cg\" (UID: \"38278dd7-d4f6-4301-a000-241dd1b54cf5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.454971 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.454952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38278dd7-d4f6-4301-a000-241dd1b54cf5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tb2cg\" (UID: \"38278dd7-d4f6-4301-a000-241dd1b54cf5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.465349 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.465321 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dslxt\" (UniqueName: \"kubernetes.io/projected/38278dd7-d4f6-4301-a000-241dd1b54cf5-kube-api-access-dslxt\") pod \"cert-manager-operator-controller-manager-55c444bf86-tb2cg\" (UID: \"38278dd7-d4f6-4301-a000-241dd1b54cf5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.633620 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.633534 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" Sep 18 13:08:24.911012 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:24.910987 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg"] Sep 18 13:08:24.913302 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:24.913271 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38278dd7_d4f6_4301_a000_241dd1b54cf5.slice/crio-546f0c6ed59d2efd88ac2d2e0bf7c3a6f22ba8258b10a029fedfbeb0c3fdc342 WatchSource:0}: Error finding container 546f0c6ed59d2efd88ac2d2e0bf7c3a6f22ba8258b10a029fedfbeb0c3fdc342: Status 404 returned error can't find the container with id 546f0c6ed59d2efd88ac2d2e0bf7c3a6f22ba8258b10a029fedfbeb0c3fdc342 Sep 18 13:08:25.667579 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:25.667541 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" event={"ID":"38278dd7-d4f6-4301-a000-241dd1b54cf5","Type":"ContainerStarted","Data":"546f0c6ed59d2efd88ac2d2e0bf7c3a6f22ba8258b10a029fedfbeb0c3fdc342"} Sep 18 13:08:26.002449 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:26.002409 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:26.101237 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:26.101201 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:26.672801 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:26.672704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" event={"ID":"38278dd7-d4f6-4301-a000-241dd1b54cf5","Type":"ContainerStarted","Data":"207d684c42cc2c7b3bc1a23e76bbcb0571d81c500f6311617a0aab14a6e2fa80"} Sep 18 13:08:26.694572 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:26.694523 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tb2cg" podStartSLOduration=1.300384139 podStartE2EDuration="2.694506963s" totalImagesPullingTime="1.394122824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:08:26.694016589 +0000 UTC m=+370.831490557" watchObservedRunningTime="2026-09-18 13:08:26.694506963 +0000 UTC m=+370.831980929" Sep 18 13:08:27.147630 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:27.147591 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:27.289509 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:27.289470 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:28.011134 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.011096 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb"] Sep 18 13:08:28.013586 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.013569 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.017212 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.017184 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 13:08:28.017339 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.017308 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jvjx5\"" Sep 18 13:08:28.025108 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.025090 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 13:08:28.045774 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.045749 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb"] Sep 18 13:08:28.083873 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.083846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.084012 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.083878 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.084012 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.083901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n779l\" (UniqueName: \"kubernetes.io/projected/775e985c-1d77-4afd-997c-ccb1df9300f7-kube-api-access-n779l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.184845 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.184813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.185268 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.184851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n779l\" (UniqueName: \"kubernetes.io/projected/775e985c-1d77-4afd-997c-ccb1df9300f7-kube-api-access-n779l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.185268 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.184932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.185362 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.185275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.185362 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.185284 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.209596 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.209571 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n779l\" (UniqueName: \"kubernetes.io/projected/775e985c-1d77-4afd-997c-ccb1df9300f7-kube-api-access-n779l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.322733 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.322651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:28.350494 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.350466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:28.471339 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.471301 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gb85z"] Sep 18 13:08:28.472472 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.472445 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:28.473901 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.473885 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:28.476622 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.476601 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 13:08:28.476739 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.476601 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 13:08:28.489252 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.489230 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gb85z"] Sep 18 13:08:28.588749 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.588671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7877aba4-71fd-42ca-8a5d-8add2de9d5f7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gb85z\" (UID: \"7877aba4-71fd-42ca-8a5d-8add2de9d5f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:28.588749 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.588706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-795jd\" (UniqueName: \"kubernetes.io/projected/7877aba4-71fd-42ca-8a5d-8add2de9d5f7-kube-api-access-795jd\") pod \"cert-manager-webhook-6486ffd997-gb85z\" (UID: \"7877aba4-71fd-42ca-8a5d-8add2de9d5f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:28.600669 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.600645 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb"] Sep 18 13:08:28.603081 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:28.603059 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775e985c_1d77_4afd_997c_ccb1df9300f7.slice/crio-1c82e37fbe8eb8c1546b6436724c02361b653c6b049418e498061fbd6299e554 WatchSource:0}: Error finding container 1c82e37fbe8eb8c1546b6436724c02361b653c6b049418e498061fbd6299e554: Status 404 returned error can't find the container with id 1c82e37fbe8eb8c1546b6436724c02361b653c6b049418e498061fbd6299e554 Sep 18 13:08:28.682807 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.682769 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" event={"ID":"775e985c-1d77-4afd-997c-ccb1df9300f7","Type":"ContainerStarted","Data":"def8870d587e1b497413b2811ce0f7d442f283e8b1d8c5c09e108d11f3f1d0df"} Sep 18 13:08:28.682956 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.682815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" event={"ID":"775e985c-1d77-4afd-997c-ccb1df9300f7","Type":"ContainerStarted","Data":"1c82e37fbe8eb8c1546b6436724c02361b653c6b049418e498061fbd6299e554"} Sep 18 13:08:28.689203 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.689182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7877aba4-71fd-42ca-8a5d-8add2de9d5f7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gb85z\" (UID: \"7877aba4-71fd-42ca-8a5d-8add2de9d5f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:28.689315 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.689223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-795jd\" (UniqueName: \"kubernetes.io/projected/7877aba4-71fd-42ca-8a5d-8add2de9d5f7-kube-api-access-795jd\") pod \"cert-manager-webhook-6486ffd997-gb85z\" (UID: \"7877aba4-71fd-42ca-8a5d-8add2de9d5f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:28.748585 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.748561 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-795jd\" (UniqueName: \"kubernetes.io/projected/7877aba4-71fd-42ca-8a5d-8add2de9d5f7-kube-api-access-795jd\") pod \"cert-manager-webhook-6486ffd997-gb85z\" (UID: \"7877aba4-71fd-42ca-8a5d-8add2de9d5f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:28.749825 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.749798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7877aba4-71fd-42ca-8a5d-8add2de9d5f7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gb85z\" (UID: \"7877aba4-71fd-42ca-8a5d-8add2de9d5f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:28.799189 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:28.799160 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:29.065830 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:29.065805 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gb85z"] Sep 18 13:08:29.068065 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:29.068043 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7877aba4_71fd_42ca_8a5d_8add2de9d5f7.slice/crio-0da89aaa7f53cfaf5a3c39cf10fdd2bb97a68f5dbe033dcaa8525256db68a4d0 WatchSource:0}: Error finding container 0da89aaa7f53cfaf5a3c39cf10fdd2bb97a68f5dbe033dcaa8525256db68a4d0: Status 404 returned error can't find the container with id 0da89aaa7f53cfaf5a3c39cf10fdd2bb97a68f5dbe033dcaa8525256db68a4d0 Sep 18 13:08:29.688665 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:29.688630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" event={"ID":"7877aba4-71fd-42ca-8a5d-8add2de9d5f7","Type":"ContainerStarted","Data":"0da89aaa7f53cfaf5a3c39cf10fdd2bb97a68f5dbe033dcaa8525256db68a4d0"} Sep 18 13:08:29.690529 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:29.690499 2580 generic.go:356] "Generic (PLEG): container finished" podID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerID="def8870d587e1b497413b2811ce0f7d442f283e8b1d8c5c09e108d11f3f1d0df" exitCode=0 Sep 18 13:08:29.690677 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:29.690550 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" event={"ID":"775e985c-1d77-4afd-997c-ccb1df9300f7","Type":"ContainerDied","Data":"def8870d587e1b497413b2811ce0f7d442f283e8b1d8c5c09e108d11f3f1d0df"} Sep 18 13:08:30.573272 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:30.573224 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:30.851555 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:30.851472 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:31.514958 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:31.514915 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:32.705135 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:32.705102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" event={"ID":"7877aba4-71fd-42ca-8a5d-8add2de9d5f7","Type":"ContainerStarted","Data":"2f0cd09077d60bba06c07880f524e53101284e88e4ed00fee84c9b69d09e6bd8"} Sep 18 13:08:32.705556 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:32.705211 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:32.706900 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:32.706877 2580 generic.go:356] "Generic (PLEG): container finished" podID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerID="1e6d40e91916b752308e04cc5b4d5e80a156d41f9e39a6a05aec974ba9d3a6ad" exitCode=0 Sep 18 13:08:32.706976 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:32.706946 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" event={"ID":"775e985c-1d77-4afd-997c-ccb1df9300f7","Type":"ContainerDied","Data":"1e6d40e91916b752308e04cc5b4d5e80a156d41f9e39a6a05aec974ba9d3a6ad"} Sep 18 13:08:32.743548 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:32.743501 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" podStartSLOduration=1.525169056 podStartE2EDuration="4.743487224s" totalImagesPullingTime="3.218318168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:08:32.742334583 +0000 UTC m=+376.879808552" watchObservedRunningTime="2026-09-18 13:08:32.743487224 +0000 UTC m=+376.880961191" Sep 18 13:08:32.995063 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:32.994988 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:33.121281 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:33.121249 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:33.712302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:33.712268 2580 generic.go:356] "Generic (PLEG): container finished" podID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerID="2767c978de798b5e58b1c97d7a2eabe5803b1726d28e2591168135ebff591398" exitCode=0 Sep 18 13:08:33.712681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:33.712353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" event={"ID":"775e985c-1d77-4afd-997c-ccb1df9300f7","Type":"ContainerDied","Data":"2767c978de798b5e58b1c97d7a2eabe5803b1726d28e2591168135ebff591398"} Sep 18 13:08:34.834717 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:34.834693 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:34.942126 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:34.942086 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-util\") pod \"775e985c-1d77-4afd-997c-ccb1df9300f7\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " Sep 18 13:08:34.942316 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:34.942146 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n779l\" (UniqueName: \"kubernetes.io/projected/775e985c-1d77-4afd-997c-ccb1df9300f7-kube-api-access-n779l\") pod \"775e985c-1d77-4afd-997c-ccb1df9300f7\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " Sep 18 13:08:34.942316 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:34.942189 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-bundle\") pod \"775e985c-1d77-4afd-997c-ccb1df9300f7\" (UID: \"775e985c-1d77-4afd-997c-ccb1df9300f7\") " Sep 18 13:08:34.942646 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:34.942612 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-bundle" (OuterVolumeSpecName: "bundle") pod "775e985c-1d77-4afd-997c-ccb1df9300f7" (UID: "775e985c-1d77-4afd-997c-ccb1df9300f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:08:34.944238 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:34.944214 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775e985c-1d77-4afd-997c-ccb1df9300f7-kube-api-access-n779l" (OuterVolumeSpecName: "kube-api-access-n779l") pod "775e985c-1d77-4afd-997c-ccb1df9300f7" (UID: "775e985c-1d77-4afd-997c-ccb1df9300f7"). InnerVolumeSpecName "kube-api-access-n779l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:08:34.947273 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:34.947246 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-util" (OuterVolumeSpecName: "util") pod "775e985c-1d77-4afd-997c-ccb1df9300f7" (UID: "775e985c-1d77-4afd-997c-ccb1df9300f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:08:35.042779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.042686 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:35.042779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.042721 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n779l\" (UniqueName: \"kubernetes.io/projected/775e985c-1d77-4afd-997c-ccb1df9300f7-kube-api-access-n779l\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:35.042779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.042731 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775e985c-1d77-4afd-997c-ccb1df9300f7-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:35.507525 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507491 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4"] Sep 18 13:08:35.507743 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507731 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerName="extract" Sep 18 13:08:35.507792 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507744 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerName="extract" Sep 18 13:08:35.507792 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507759 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerName="pull" Sep 18 13:08:35.507792 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507764 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerName="pull" Sep 18 13:08:35.507792 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507775 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerName="util" Sep 18 13:08:35.507792 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507781 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerName="util" Sep 18 13:08:35.507948 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.507821 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="775e985c-1d77-4afd-997c-ccb1df9300f7" containerName="extract" Sep 18 13:08:35.511406 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.511372 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:35.514620 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.514598 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ccp7v\"" Sep 18 13:08:35.525021 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.524999 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4"] Sep 18 13:08:35.547544 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.547513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gjf\" (UniqueName: \"kubernetes.io/projected/df21aa90-23ac-405d-8744-f273dd6f9bc7-kube-api-access-h4gjf\") pod \"cert-manager-cainjector-559cdd8c87-w8rr4\" (UID: \"df21aa90-23ac-405d-8744-f273dd6f9bc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:35.547673 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.547551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df21aa90-23ac-405d-8744-f273dd6f9bc7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w8rr4\" (UID: \"df21aa90-23ac-405d-8744-f273dd6f9bc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:35.648836 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.648798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gjf\" (UniqueName: \"kubernetes.io/projected/df21aa90-23ac-405d-8744-f273dd6f9bc7-kube-api-access-h4gjf\") pod \"cert-manager-cainjector-559cdd8c87-w8rr4\" (UID: \"df21aa90-23ac-405d-8744-f273dd6f9bc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:35.649005 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.648845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df21aa90-23ac-405d-8744-f273dd6f9bc7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w8rr4\" (UID: \"df21aa90-23ac-405d-8744-f273dd6f9bc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:35.663162 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.663131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gjf\" (UniqueName: \"kubernetes.io/projected/df21aa90-23ac-405d-8744-f273dd6f9bc7-kube-api-access-h4gjf\") pod \"cert-manager-cainjector-559cdd8c87-w8rr4\" (UID: \"df21aa90-23ac-405d-8744-f273dd6f9bc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:35.666188 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.666160 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df21aa90-23ac-405d-8744-f273dd6f9bc7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w8rr4\" (UID: \"df21aa90-23ac-405d-8744-f273dd6f9bc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:35.721497 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.721477 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" Sep 18 13:08:35.721497 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.721482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpghb" event={"ID":"775e985c-1d77-4afd-997c-ccb1df9300f7","Type":"ContainerDied","Data":"1c82e37fbe8eb8c1546b6436724c02361b653c6b049418e498061fbd6299e554"} Sep 18 13:08:35.721637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.721519 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c82e37fbe8eb8c1546b6436724c02361b653c6b049418e498061fbd6299e554" Sep 18 13:08:35.819554 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:35.819473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" Sep 18 13:08:36.113674 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:36.113599 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4"] Sep 18 13:08:36.116753 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:36.116727 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf21aa90_23ac_405d_8744_f273dd6f9bc7.slice/crio-0bc0dfed904dad95c9d9177850e0184a86cc755047d9ee647100c52f79c9e0d5 WatchSource:0}: Error finding container 0bc0dfed904dad95c9d9177850e0184a86cc755047d9ee647100c52f79c9e0d5: Status 404 returned error can't find the container with id 0bc0dfed904dad95c9d9177850e0184a86cc755047d9ee647100c52f79c9e0d5 Sep 18 13:08:36.727183 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:36.727143 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" event={"ID":"df21aa90-23ac-405d-8744-f273dd6f9bc7","Type":"ContainerStarted","Data":"c3f91b3221a9a29cf97439c70fe16ea1e653dc65ad60a71c341dd6f42ada921d"} Sep 18 13:08:36.727183 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:36.727186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" event={"ID":"df21aa90-23ac-405d-8744-f273dd6f9bc7","Type":"ContainerStarted","Data":"0bc0dfed904dad95c9d9177850e0184a86cc755047d9ee647100c52f79c9e0d5"} Sep 18 13:08:36.761241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:36.761186 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w8rr4" podStartSLOduration=1.761171306 podStartE2EDuration="1.761171306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:08:36.760833072 +0000 UTC m=+380.898307038" watchObservedRunningTime="2026-09-18 13:08:36.761171306 +0000 UTC m=+380.898645272" Sep 18 13:08:37.154463 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:37.154354 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:37.488914 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:37.488877 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:38.092190 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:38.092159 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:38.715438 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:38.715404 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gb85z" Sep 18 13:08:38.962154 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:38.962119 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d22l2"] Sep 18 13:08:38.966132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:38.966091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:38.969874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:38.969855 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x4k5c\"" Sep 18 13:08:38.995664 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:38.995641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d22l2"] Sep 18 13:08:39.075241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.075209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qfl\" (UniqueName: \"kubernetes.io/projected/8e938660-f688-4101-b0c6-3b24b6891477-kube-api-access-p9qfl\") pod \"cert-manager-55b4d954d5-d22l2\" (UID: \"8e938660-f688-4101-b0c6-3b24b6891477\") " pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:39.075419 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.075250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e938660-f688-4101-b0c6-3b24b6891477-bound-sa-token\") pod \"cert-manager-55b4d954d5-d22l2\" (UID: \"8e938660-f688-4101-b0c6-3b24b6891477\") " pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:39.176057 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.176021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qfl\" (UniqueName: \"kubernetes.io/projected/8e938660-f688-4101-b0c6-3b24b6891477-kube-api-access-p9qfl\") pod \"cert-manager-55b4d954d5-d22l2\" (UID: \"8e938660-f688-4101-b0c6-3b24b6891477\") " pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:39.176192 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.176067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e938660-f688-4101-b0c6-3b24b6891477-bound-sa-token\") pod \"cert-manager-55b4d954d5-d22l2\" (UID: \"8e938660-f688-4101-b0c6-3b24b6891477\") " pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:39.194615 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.194590 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e938660-f688-4101-b0c6-3b24b6891477-bound-sa-token\") pod \"cert-manager-55b4d954d5-d22l2\" (UID: \"8e938660-f688-4101-b0c6-3b24b6891477\") " pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:39.194788 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.194770 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qfl\" (UniqueName: \"kubernetes.io/projected/8e938660-f688-4101-b0c6-3b24b6891477-kube-api-access-p9qfl\") pod \"cert-manager-55b4d954d5-d22l2\" (UID: \"8e938660-f688-4101-b0c6-3b24b6891477\") " pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:39.274750 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.274691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d22l2" Sep 18 13:08:39.564153 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.564080 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d22l2"] Sep 18 13:08:39.568131 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:39.568103 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e938660_f688_4101_b0c6_3b24b6891477.slice/crio-58442fb6321aee60aa924e3a2e1e75e862ed4cdde4170bbdebd26330bd5fedaa WatchSource:0}: Error finding container 58442fb6321aee60aa924e3a2e1e75e862ed4cdde4170bbdebd26330bd5fedaa: Status 404 returned error can't find the container with id 58442fb6321aee60aa924e3a2e1e75e862ed4cdde4170bbdebd26330bd5fedaa Sep 18 13:08:39.741515 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.741476 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d22l2" event={"ID":"8e938660-f688-4101-b0c6-3b24b6891477","Type":"ContainerStarted","Data":"82a6d75ff97450b754dca3aea281520744ec3ab5832b6c8dfc302ec14a13a708"} Sep 18 13:08:39.741515 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.741520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d22l2" event={"ID":"8e938660-f688-4101-b0c6-3b24b6891477","Type":"ContainerStarted","Data":"58442fb6321aee60aa924e3a2e1e75e862ed4cdde4170bbdebd26330bd5fedaa"} Sep 18 13:08:39.791257 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:39.791202 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-d22l2" podStartSLOduration=1.791185367 podStartE2EDuration="1.791185367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:08:39.790724838 +0000 UTC m=+383.928198805" watchObservedRunningTime="2026-09-18 13:08:39.791185367 +0000 UTC m=+383.928659334" Sep 18 13:08:40.861743 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:40.861709 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:41.123241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:41.123154 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:47.024264 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:47.024225 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:47.128546 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:47.128514 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:48.229925 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.229888 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph"] Sep 18 13:08:48.284145 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.284111 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph"] Sep 18 13:08:48.284311 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.284215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.287466 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.287437 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 13:08:48.288099 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.288070 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 13:08:48.289423 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.289401 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jvjx5\"" Sep 18 13:08:48.353283 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.353242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.353473 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.353297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.353473 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.353326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cnm\" (UniqueName: \"kubernetes.io/projected/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-kube-api-access-48cnm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.454297 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.454261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.454498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.454308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cnm\" (UniqueName: \"kubernetes.io/projected/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-kube-api-access-48cnm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.454498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.454428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.454675 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.454654 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.454761 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.454739 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.464749 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.464727 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cnm\" (UniqueName: \"kubernetes.io/projected/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-kube-api-access-48cnm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.596272 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.596191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:48.889100 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.889049 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph"] Sep 18 13:08:48.891840 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:48.891808 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4d98ba_8d4a_4d13_b8a5_45349bbd953b.slice/crio-48d3a7475cb03c12a5f59a7a921309b12c61ed0611af41b65c751d344bd07843 WatchSource:0}: Error finding container 48d3a7475cb03c12a5f59a7a921309b12c61ed0611af41b65c751d344bd07843: Status 404 returned error can't find the container with id 48d3a7475cb03c12a5f59a7a921309b12c61ed0611af41b65c751d344bd07843 Sep 18 13:08:48.926857 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:48.926820 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:08:49.783842 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:49.783758 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerID="e3bc8328f8df5e43151dec9f8217b65f1a3b67084e44f312f4ff686b23942a7f" exitCode=0 Sep 18 13:08:49.784262 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:49.783843 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" event={"ID":"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b","Type":"ContainerDied","Data":"e3bc8328f8df5e43151dec9f8217b65f1a3b67084e44f312f4ff686b23942a7f"} Sep 18 13:08:49.784262 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:49.783900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" event={"ID":"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b","Type":"ContainerStarted","Data":"48d3a7475cb03c12a5f59a7a921309b12c61ed0611af41b65c751d344bd07843"} Sep 18 13:08:50.789576 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:50.789543 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerID="6073fdda02f0d99dbd64c1ff269fb5469caf281324834b0974b8718d4809c9ed" exitCode=0 Sep 18 13:08:50.789958 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:50.789603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" event={"ID":"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b","Type":"ContainerDied","Data":"6073fdda02f0d99dbd64c1ff269fb5469caf281324834b0974b8718d4809c9ed"} Sep 18 13:08:51.796505 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:51.796465 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerID="d9ec721a54a94e4b0aa73129de57df71aeeddc6ae3c5c7ebfb90b30424f8d6e5" exitCode=0 Sep 18 13:08:51.796879 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:51.796551 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" event={"ID":"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b","Type":"ContainerDied","Data":"d9ec721a54a94e4b0aa73129de57df71aeeddc6ae3c5c7ebfb90b30424f8d6e5"} Sep 18 13:08:52.917917 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:52.917892 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:52.987792 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:52.987760 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-bundle\") pod \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " Sep 18 13:08:52.987955 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:52.987819 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-util\") pod \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " Sep 18 13:08:52.987955 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:52.987878 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48cnm\" (UniqueName: \"kubernetes.io/projected/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-kube-api-access-48cnm\") pod \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\" (UID: \"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b\") " Sep 18 13:08:52.988506 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:52.988467 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-bundle" (OuterVolumeSpecName: "bundle") pod "8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" (UID: "8b4d98ba-8d4a-4d13-b8a5-45349bbd953b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:08:52.990004 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:52.989976 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-kube-api-access-48cnm" (OuterVolumeSpecName: "kube-api-access-48cnm") pod "8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" (UID: "8b4d98ba-8d4a-4d13-b8a5-45349bbd953b"). InnerVolumeSpecName "kube-api-access-48cnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:08:52.993462 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:52.993423 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-util" (OuterVolumeSpecName: "util") pod "8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" (UID: "8b4d98ba-8d4a-4d13-b8a5-45349bbd953b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:08:53.088619 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:53.088515 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:53.088619 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:53.088560 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:53.088619 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:53.088570 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48cnm\" (UniqueName: \"kubernetes.io/projected/8b4d98ba-8d4a-4d13-b8a5-45349bbd953b-kube-api-access-48cnm\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:08:53.807639 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:53.807604 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" event={"ID":"8b4d98ba-8d4a-4d13-b8a5-45349bbd953b","Type":"ContainerDied","Data":"48d3a7475cb03c12a5f59a7a921309b12c61ed0611af41b65c751d344bd07843"} Sep 18 13:08:53.807639 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:53.807626 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgbjph" Sep 18 13:08:53.807850 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:53.807657 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48d3a7475cb03c12a5f59a7a921309b12c61ed0611af41b65c751d344bd07843" Sep 18 13:08:59.073675 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073636 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg"] Sep 18 13:08:59.074037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073889 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerName="pull" Sep 18 13:08:59.074037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073900 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerName="pull" Sep 18 13:08:59.074037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073910 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerName="util" Sep 18 13:08:59.074037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073918 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerName="util" Sep 18 13:08:59.074037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073935 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerName="extract" Sep 18 13:08:59.074037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073940 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerName="extract" Sep 18 13:08:59.074037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.073982 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b4d98ba-8d4a-4d13-b8a5-45349bbd953b" containerName="extract" Sep 18 13:08:59.076453 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.076435 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.079287 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.079264 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 13:08:59.080296 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.080276 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 13:08:59.080417 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.080311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jvjx5\"" Sep 18 13:08:59.087841 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.087819 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg"] Sep 18 13:08:59.240503 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.240452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.240503 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.240515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.240772 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.240596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7qls\" (UniqueName: \"kubernetes.io/projected/cb141401-2d2e-4c77-a184-3e9050dd10f2-kube-api-access-d7qls\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.341594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.341491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.341594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.341552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.341594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.341594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7qls\" (UniqueName: \"kubernetes.io/projected/cb141401-2d2e-4c77-a184-3e9050dd10f2-kube-api-access-d7qls\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.341949 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.341926 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.342012 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.341949 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.351384 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.351354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7qls\" (UniqueName: \"kubernetes.io/projected/cb141401-2d2e-4c77-a184-3e9050dd10f2-kube-api-access-d7qls\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.384746 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.384719 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:08:59.679681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.679650 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg"] Sep 18 13:08:59.680914 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:08:59.680884 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb141401_2d2e_4c77_a184_3e9050dd10f2.slice/crio-5bf7be60bf0e5bae78c89cb965070f793a1fa47ce24d36048f1b2e73f59a955c WatchSource:0}: Error finding container 5bf7be60bf0e5bae78c89cb965070f793a1fa47ce24d36048f1b2e73f59a955c: Status 404 returned error can't find the container with id 5bf7be60bf0e5bae78c89cb965070f793a1fa47ce24d36048f1b2e73f59a955c Sep 18 13:08:59.833881 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.833850 2580 generic.go:356] "Generic (PLEG): container finished" podID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerID="9a75b33f29da56bbd42beb29dc08ca5278d6241d60e6cd420f77ef0482534005" exitCode=0 Sep 18 13:08:59.834041 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.833890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" event={"ID":"cb141401-2d2e-4c77-a184-3e9050dd10f2","Type":"ContainerDied","Data":"9a75b33f29da56bbd42beb29dc08ca5278d6241d60e6cd420f77ef0482534005"} Sep 18 13:08:59.834041 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:08:59.833927 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" event={"ID":"cb141401-2d2e-4c77-a184-3e9050dd10f2","Type":"ContainerStarted","Data":"5bf7be60bf0e5bae78c89cb965070f793a1fa47ce24d36048f1b2e73f59a955c"} Sep 18 13:09:00.214428 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:00.214393 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:00.334705 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:00.334671 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:00.815256 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:00.815167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:00.840769 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:00.840735 2580 generic.go:356] "Generic (PLEG): container finished" podID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerID="11a7298e9e8524898998f248d1c6b3ce5cdbdffe939b872885e778d6df3b2e0f" exitCode=0 Sep 18 13:09:00.840914 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:00.840814 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" event={"ID":"cb141401-2d2e-4c77-a184-3e9050dd10f2","Type":"ContainerDied","Data":"11a7298e9e8524898998f248d1c6b3ce5cdbdffe939b872885e778d6df3b2e0f"} Sep 18 13:09:01.302251 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.302215 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:01.412591 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.412556 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:01.438169 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.438134 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z"] Sep 18 13:09:01.440285 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.440269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.443916 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.443891 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 13:09:01.444813 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.444787 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 13:09:01.444927 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.444835 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rbf7n\"" Sep 18 13:09:01.444927 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.444874 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 13:09:01.444927 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.444875 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 13:09:01.474347 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.474318 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z"] Sep 18 13:09:01.558551 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.558459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e53bac64-210e-47eb-8f30-422ef6868ae3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.558551 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.558526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e53bac64-210e-47eb-8f30-422ef6868ae3-manifests\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.558756 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.558557 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbncc\" (UniqueName: \"kubernetes.io/projected/e53bac64-210e-47eb-8f30-422ef6868ae3-kube-api-access-sbncc\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.558756 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.558596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e53bac64-210e-47eb-8f30-422ef6868ae3-webhook-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.558756 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.558665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e53bac64-210e-47eb-8f30-422ef6868ae3-tmp\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.590348 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.590304 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:01.659490 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.659457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e53bac64-210e-47eb-8f30-422ef6868ae3-webhook-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.659783 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.659515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e53bac64-210e-47eb-8f30-422ef6868ae3-tmp\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.659783 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.659554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e53bac64-210e-47eb-8f30-422ef6868ae3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.659783 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.659605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e53bac64-210e-47eb-8f30-422ef6868ae3-manifests\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.659783 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.659632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbncc\" (UniqueName: \"kubernetes.io/projected/e53bac64-210e-47eb-8f30-422ef6868ae3-kube-api-access-sbncc\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.660045 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.660024 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e53bac64-210e-47eb-8f30-422ef6868ae3-manifests\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.661931 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.661903 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e53bac64-210e-47eb-8f30-422ef6868ae3-tmp\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.662030 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.661983 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e53bac64-210e-47eb-8f30-422ef6868ae3-webhook-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.662030 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.662019 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e53bac64-210e-47eb-8f30-422ef6868ae3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.674543 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.674516 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbncc\" (UniqueName: \"kubernetes.io/projected/e53bac64-210e-47eb-8f30-422ef6868ae3-kube-api-access-sbncc\") pod \"opendatahub-operator-controller-manager-57ff796844-4wb2z\" (UID: \"e53bac64-210e-47eb-8f30-422ef6868ae3\") " pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.694074 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.694047 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:01.750102 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.750065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:01.791651 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.791619 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:01.850521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.850422 2580 generic.go:356] "Generic (PLEG): container finished" podID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerID="85a625145c79a0c60350e42ef0dcd33e4c01c949d26216963f00681c6ba2d033" exitCode=0 Sep 18 13:09:01.850521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.850499 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" event={"ID":"cb141401-2d2e-4c77-a184-3e9050dd10f2","Type":"ContainerDied","Data":"85a625145c79a0c60350e42ef0dcd33e4c01c949d26216963f00681c6ba2d033"} Sep 18 13:09:01.874356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.874312 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:01.955544 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:01.955501 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:02.026504 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:02.026461 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z"] Sep 18 13:09:02.029133 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:09:02.029107 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53bac64_210e_47eb_8f30_422ef6868ae3.slice/crio-99f930406480de4aaf2e1364d4b60e63dbb35bb733e6607ebab482f014a92c15 WatchSource:0}: Error finding container 99f930406480de4aaf2e1364d4b60e63dbb35bb733e6607ebab482f014a92c15: Status 404 returned error can't find the container with id 99f930406480de4aaf2e1364d4b60e63dbb35bb733e6607ebab482f014a92c15 Sep 18 13:09:02.858212 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:02.858175 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" event={"ID":"e53bac64-210e-47eb-8f30-422ef6868ae3","Type":"ContainerStarted","Data":"99f930406480de4aaf2e1364d4b60e63dbb35bb733e6607ebab482f014a92c15"} Sep 18 13:09:02.999161 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:02.999070 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:09:03.171340 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.171253 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-bundle\") pod \"cb141401-2d2e-4c77-a184-3e9050dd10f2\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " Sep 18 13:09:03.171514 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.171419 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-util\") pod \"cb141401-2d2e-4c77-a184-3e9050dd10f2\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " Sep 18 13:09:03.171514 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.171453 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7qls\" (UniqueName: \"kubernetes.io/projected/cb141401-2d2e-4c77-a184-3e9050dd10f2-kube-api-access-d7qls\") pod \"cb141401-2d2e-4c77-a184-3e9050dd10f2\" (UID: \"cb141401-2d2e-4c77-a184-3e9050dd10f2\") " Sep 18 13:09:03.172157 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.172126 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-bundle" (OuterVolumeSpecName: "bundle") pod "cb141401-2d2e-4c77-a184-3e9050dd10f2" (UID: "cb141401-2d2e-4c77-a184-3e9050dd10f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:09:03.173865 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.173833 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb141401-2d2e-4c77-a184-3e9050dd10f2-kube-api-access-d7qls" (OuterVolumeSpecName: "kube-api-access-d7qls") pod "cb141401-2d2e-4c77-a184-3e9050dd10f2" (UID: "cb141401-2d2e-4c77-a184-3e9050dd10f2"). InnerVolumeSpecName "kube-api-access-d7qls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:09:03.180770 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.180729 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-util" (OuterVolumeSpecName: "util") pod "cb141401-2d2e-4c77-a184-3e9050dd10f2" (UID: "cb141401-2d2e-4c77-a184-3e9050dd10f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:09:03.272681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.272636 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:09:03.272681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.272672 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7qls\" (UniqueName: \"kubernetes.io/projected/cb141401-2d2e-4c77-a184-3e9050dd10f2-kube-api-access-d7qls\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:09:03.272910 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.272698 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb141401-2d2e-4c77-a184-3e9050dd10f2-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:09:03.866226 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.866196 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" Sep 18 13:09:03.866658 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.866195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0bqrhg" event={"ID":"cb141401-2d2e-4c77-a184-3e9050dd10f2","Type":"ContainerDied","Data":"5bf7be60bf0e5bae78c89cb965070f793a1fa47ce24d36048f1b2e73f59a955c"} Sep 18 13:09:03.866658 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:03.866325 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bf7be60bf0e5bae78c89cb965070f793a1fa47ce24d36048f1b2e73f59a955c" Sep 18 13:09:05.877748 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:05.877707 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" event={"ID":"e53bac64-210e-47eb-8f30-422ef6868ae3","Type":"ContainerStarted","Data":"4291f19c06622b15d3bbe6bb3b56934163b15539856b8c660028c50b943f40ce"} Sep 18 13:09:06.883751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:06.883712 2580 generic.go:356] "Generic (PLEG): container finished" podID="e53bac64-210e-47eb-8f30-422ef6868ae3" containerID="4291f19c06622b15d3bbe6bb3b56934163b15539856b8c660028c50b943f40ce" exitCode=0 Sep 18 13:09:06.884109 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:06.883761 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" event={"ID":"e53bac64-210e-47eb-8f30-422ef6868ae3","Type":"ContainerDied","Data":"4291f19c06622b15d3bbe6bb3b56934163b15539856b8c660028c50b943f40ce"} Sep 18 13:09:07.890125 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:07.890091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" event={"ID":"e53bac64-210e-47eb-8f30-422ef6868ae3","Type":"ContainerStarted","Data":"f42b413a8e6652a5bf12316e5c1f2ca319ea0522078b1284a565886c26089c3f"} Sep 18 13:09:07.890568 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:07.890162 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:09.195572 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:09.195540 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:09.278001 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:09.277968 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:15.635061 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:15.635032 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:18.895997 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:18.895968 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" Sep 18 13:09:18.919653 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:18.919597 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57ff796844-4wb2z" podStartSLOduration=13.272691535 podStartE2EDuration="17.91957955s" totalImagesPullingTime="3.592928929s" totalInitContainerRuntime="1.053959086s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:08.002213294 +0000 UTC m=+412.139687261" watchObservedRunningTime="2026-09-18 13:09:18.91957955 +0000 UTC m=+423.057053518" Sep 18 13:09:20.498508 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:20.498470 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:20.649160 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:20.649118 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:20.993126 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:20.993095 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:21.339567 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.339534 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:21.656120 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656038 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs"] Sep 18 13:09:21.656493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656311 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerName="pull" Sep 18 13:09:21.656493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656322 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerName="pull" Sep 18 13:09:21.656493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656334 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerName="extract" Sep 18 13:09:21.656493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656341 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerName="extract" Sep 18 13:09:21.656493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656351 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerName="util" Sep 18 13:09:21.656493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656357 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerName="util" Sep 18 13:09:21.656493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.656411 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb141401-2d2e-4c77-a184-3e9050dd10f2" containerName="extract" Sep 18 13:09:21.666251 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.666229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.668832 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.668805 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 18 13:09:21.669638 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.669614 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 18 13:09:21.669759 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.669644 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g64dq\"" Sep 18 13:09:21.669759 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.669729 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 18 13:09:21.669875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.669759 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 18 13:09:21.669875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.669869 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 18 13:09:21.670356 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.670333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs"] Sep 18 13:09:21.715062 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.715031 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6d5r\" (UniqueName: \"kubernetes.io/projected/3ab7b323-bfdb-4401-8582-a442998aceea-kube-api-access-b6d5r\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.715212 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.715067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ab7b323-bfdb-4401-8582-a442998aceea-cert\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.715212 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.715093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ab7b323-bfdb-4401-8582-a442998aceea-manager-config\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.715212 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.715115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ab7b323-bfdb-4401-8582-a442998aceea-metrics-cert\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.815472 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.815443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ab7b323-bfdb-4401-8582-a442998aceea-cert\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.815632 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.815477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ab7b323-bfdb-4401-8582-a442998aceea-manager-config\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.815632 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.815502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ab7b323-bfdb-4401-8582-a442998aceea-metrics-cert\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.815632 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.815544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6d5r\" (UniqueName: \"kubernetes.io/projected/3ab7b323-bfdb-4401-8582-a442998aceea-kube-api-access-b6d5r\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.816096 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.816066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ab7b323-bfdb-4401-8582-a442998aceea-manager-config\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.818007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.817979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ab7b323-bfdb-4401-8582-a442998aceea-metrics-cert\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.818007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.817996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ab7b323-bfdb-4401-8582-a442998aceea-cert\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.835354 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.835312 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6d5r\" (UniqueName: \"kubernetes.io/projected/3ab7b323-bfdb-4401-8582-a442998aceea-kube-api-access-b6d5r\") pod \"lws-controller-manager-b4c5b8666-c6hhs\" (UID: \"3ab7b323-bfdb-4401-8582-a442998aceea\") " pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:21.976632 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:21.976601 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:22.260634 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:22.260559 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs"] Sep 18 13:09:22.263592 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:09:22.263564 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab7b323_bfdb_4401_8582_a442998aceea.slice/crio-d0e7b81e93f680c35e06c7b19cee4efdbedb5b34f72692086c6bed02e42af4bf WatchSource:0}: Error finding container d0e7b81e93f680c35e06c7b19cee4efdbedb5b34f72692086c6bed02e42af4bf: Status 404 returned error can't find the container with id d0e7b81e93f680c35e06c7b19cee4efdbedb5b34f72692086c6bed02e42af4bf Sep 18 13:09:22.664195 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:22.664120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:22.747648 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:22.747597 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:22.959672 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:22.959640 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" event={"ID":"3ab7b323-bfdb-4401-8582-a442998aceea","Type":"ContainerStarted","Data":"d0e7b81e93f680c35e06c7b19cee4efdbedb5b34f72692086c6bed02e42af4bf"} Sep 18 13:09:23.666628 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:23.666591 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:23.965541 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:23.965507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" event={"ID":"3ab7b323-bfdb-4401-8582-a442998aceea","Type":"ContainerStarted","Data":"056caba4c90ee1915def1f057db3360aae424d1e863d7d4b04422dbf4e0a7417"} Sep 18 13:09:23.965737 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:23.965623 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:27.675565 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:27.675503 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:27.774201 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:27.774153 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:28.524195 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.524114 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" podStartSLOduration=6.06741749 podStartE2EDuration="7.524096059s" totalImagesPullingTime="1.456678569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:24.001153023 +0000 UTC m=+428.138627011" watchObservedRunningTime="2026-09-18 13:09:28.524096059 +0000 UTC m=+432.661570025" Sep 18 13:09:28.524445 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.524258 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k"] Sep 18 13:09:28.526743 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.526722 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.529711 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.529684 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 13:09:28.529828 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.529793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2pc2r\"" Sep 18 13:09:28.529972 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.529951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 13:09:28.530175 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.530161 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 13:09:28.543708 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.543686 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k"] Sep 18 13:09:28.559282 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559421 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559294 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559421 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559421 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559566 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559566 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22cm4\" (UniqueName: \"kubernetes.io/projected/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-kube-api-access-22cm4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559566 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559566 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.559727 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.559595 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.560213 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.560187 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:28.660031 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.659984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660031 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660298 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660069 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660298 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660298 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660298 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660542 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660542 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660542 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22cm4\" (UniqueName: \"kubernetes.io/projected/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-kube-api-access-22cm4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660542 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660472 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660734 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660714 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660787 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660775 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.660889 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.660867 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.661143 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.661121 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.662876 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.662853 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.662991 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.662973 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.671155 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.671129 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.671282 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.671232 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22cm4\" (UniqueName: \"kubernetes.io/projected/4d0f9097-ae43-470d-bdab-2e6ff704c6ca-kube-api-access-22cm4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k\" (UID: \"4d0f9097-ae43-470d-bdab-2e6ff704c6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.821550 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.821447 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:28.836902 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.836875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:28.917085 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:28.917042 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:29.112896 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:29.112823 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k"] Sep 18 13:09:29.115767 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:09:29.115739 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0f9097_ae43_470d_bdab_2e6ff704c6ca.slice/crio-6ba97fd26574a61bf8f72595940d7a66f5a45a925d173b99de14b243d383bff4 WatchSource:0}: Error finding container 6ba97fd26574a61bf8f72595940d7a66f5a45a925d173b99de14b243d383bff4: Status 404 returned error can't find the container with id 6ba97fd26574a61bf8f72595940d7a66f5a45a925d173b99de14b243d383bff4 Sep 18 13:09:29.994990 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:29.994953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" event={"ID":"4d0f9097-ae43-470d-bdab-2e6ff704c6ca","Type":"ContainerStarted","Data":"6ba97fd26574a61bf8f72595940d7a66f5a45a925d173b99de14b243d383bff4"} Sep 18 13:09:31.396710 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.396673 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2s9bh"] Sep 18 13:09:31.399235 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.399213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:31.402591 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.402566 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 18 13:09:31.402707 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.402580 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8x75g\"" Sep 18 13:09:31.468570 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.468478 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2s9bh"] Sep 18 13:09:31.485025 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.484970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61d7dd94-3915-4a0b-80da-99f1d230f32c-cert\") pod \"odh-model-controller-7998c67dc4-2s9bh\" (UID: \"61d7dd94-3915-4a0b-80da-99f1d230f32c\") " pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:31.485183 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.485055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc7c4\" (UniqueName: \"kubernetes.io/projected/61d7dd94-3915-4a0b-80da-99f1d230f32c-kube-api-access-nc7c4\") pod \"odh-model-controller-7998c67dc4-2s9bh\" (UID: \"61d7dd94-3915-4a0b-80da-99f1d230f32c\") " pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:31.568083 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.568052 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:31.586321 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.586274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61d7dd94-3915-4a0b-80da-99f1d230f32c-cert\") pod \"odh-model-controller-7998c67dc4-2s9bh\" (UID: \"61d7dd94-3915-4a0b-80da-99f1d230f32c\") " pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:31.586509 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.586338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc7c4\" (UniqueName: \"kubernetes.io/projected/61d7dd94-3915-4a0b-80da-99f1d230f32c-kube-api-access-nc7c4\") pod \"odh-model-controller-7998c67dc4-2s9bh\" (UID: \"61d7dd94-3915-4a0b-80da-99f1d230f32c\") " pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:31.586509 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:09:31.586463 2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 18 13:09:31.586612 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:09:31.586553 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d7dd94-3915-4a0b-80da-99f1d230f32c-cert podName:61d7dd94-3915-4a0b-80da-99f1d230f32c nodeName:}" failed. No retries permitted until 2026-09-18 13:09:32.086529766 +0000 UTC m=+436.224003717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61d7dd94-3915-4a0b-80da-99f1d230f32c-cert") pod "odh-model-controller-7998c67dc4-2s9bh" (UID: "61d7dd94-3915-4a0b-80da-99f1d230f32c") : secret "odh-model-controller-webhook-cert" not found Sep 18 13:09:31.601551 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.601522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc7c4\" (UniqueName: \"kubernetes.io/projected/61d7dd94-3915-4a0b-80da-99f1d230f32c-kube-api-access-nc7c4\") pod \"odh-model-controller-7998c67dc4-2s9bh\" (UID: \"61d7dd94-3915-4a0b-80da-99f1d230f32c\") " pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:31.878709 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:31.878676 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:32.090725 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.090683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61d7dd94-3915-4a0b-80da-99f1d230f32c-cert\") pod \"odh-model-controller-7998c67dc4-2s9bh\" (UID: \"61d7dd94-3915-4a0b-80da-99f1d230f32c\") " pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:32.093450 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.093420 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61d7dd94-3915-4a0b-80da-99f1d230f32c-cert\") pod \"odh-model-controller-7998c67dc4-2s9bh\" (UID: \"61d7dd94-3915-4a0b-80da-99f1d230f32c\") " pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:32.217834 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.217792 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vmfnt"] Sep 18 13:09:32.225148 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.225084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.229174 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.229144 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 18 13:09:32.238733 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.238701 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:32.239056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.239033 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vmfnt"] Sep 18 13:09:32.292646 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.292606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37775b30-b00f-4a53-9592-062c940e0516-tls-certs\") pod \"model-serving-api-54d89bd5fc-vmfnt\" (UID: \"37775b30-b00f-4a53-9592-062c940e0516\") " pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.292807 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.292657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2sts\" (UniqueName: \"kubernetes.io/projected/37775b30-b00f-4a53-9592-062c940e0516-kube-api-access-s2sts\") pod \"model-serving-api-54d89bd5fc-vmfnt\" (UID: \"37775b30-b00f-4a53-9592-062c940e0516\") " pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.310531 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.310497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:32.393124 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.393086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37775b30-b00f-4a53-9592-062c940e0516-tls-certs\") pod \"model-serving-api-54d89bd5fc-vmfnt\" (UID: \"37775b30-b00f-4a53-9592-062c940e0516\") " pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.393324 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.393155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2sts\" (UniqueName: \"kubernetes.io/projected/37775b30-b00f-4a53-9592-062c940e0516-kube-api-access-s2sts\") pod \"model-serving-api-54d89bd5fc-vmfnt\" (UID: \"37775b30-b00f-4a53-9592-062c940e0516\") " pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.395954 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.395923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37775b30-b00f-4a53-9592-062c940e0516-tls-certs\") pod \"model-serving-api-54d89bd5fc-vmfnt\" (UID: \"37775b30-b00f-4a53-9592-062c940e0516\") " pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.402705 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.402680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2sts\" (UniqueName: \"kubernetes.io/projected/37775b30-b00f-4a53-9592-062c940e0516-kube-api-access-s2sts\") pod \"model-serving-api-54d89bd5fc-vmfnt\" (UID: \"37775b30-b00f-4a53-9592-062c940e0516\") " pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.489742 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.489592 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:09:32.489742 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.489695 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:09:32.489894 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.489742 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:09:32.507530 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.507500 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:32.538204 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.538176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:32.743698 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.743673 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2s9bh"] Sep 18 13:09:32.745527 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:09:32.745496 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d7dd94_3915_4a0b_80da_99f1d230f32c.slice/crio-0197505bb06192c4fc29a645f915a48bd8a563fb91f572569dfe1fd7c877d73a WatchSource:0}: Error finding container 0197505bb06192c4fc29a645f915a48bd8a563fb91f572569dfe1fd7c877d73a: Status 404 returned error can't find the container with id 0197505bb06192c4fc29a645f915a48bd8a563fb91f572569dfe1fd7c877d73a Sep 18 13:09:32.829945 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:32.829919 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vmfnt"] Sep 18 13:09:32.831662 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:09:32.831639 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37775b30_b00f_4a53_9592_062c940e0516.slice/crio-675ce78e3939e1245759df51ccee6b23ac94b9c87110375f88ada79f7ee81a46 WatchSource:0}: Error finding container 675ce78e3939e1245759df51ccee6b23ac94b9c87110375f88ada79f7ee81a46: Status 404 returned error can't find the container with id 675ce78e3939e1245759df51ccee6b23ac94b9c87110375f88ada79f7ee81a46 Sep 18 13:09:33.011175 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:33.011083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" event={"ID":"4d0f9097-ae43-470d-bdab-2e6ff704c6ca","Type":"ContainerStarted","Data":"40756f38e7592a0f18dfa44d598ac93280d298e9089162e1c6f0eaa1720aad5a"} Sep 18 13:09:33.012405 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:33.012356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" event={"ID":"37775b30-b00f-4a53-9592-062c940e0516","Type":"ContainerStarted","Data":"675ce78e3939e1245759df51ccee6b23ac94b9c87110375f88ada79f7ee81a46"} Sep 18 13:09:33.013590 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:33.013568 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" event={"ID":"61d7dd94-3915-4a0b-80da-99f1d230f32c","Type":"ContainerStarted","Data":"0197505bb06192c4fc29a645f915a48bd8a563fb91f572569dfe1fd7c877d73a"} Sep 18 13:09:33.033691 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:33.033642 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" podStartSLOduration=1.662197143 podStartE2EDuration="5.033623571s" totalImagesPullingTime="3.371426428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:33.031566182 +0000 UTC m=+437.169040149" watchObservedRunningTime="2026-09-18 13:09:33.033623571 +0000 UTC m=+437.171097537" Sep 18 13:09:33.837703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:33.837659 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:33.844036 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:33.844009 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:34.022143 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:34.022115 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:34.023067 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:34.023045 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k" Sep 18 13:09:34.972841 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:34.972791 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b4c5b8666-c6hhs" Sep 18 13:09:37.037540 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:37.037495 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" event={"ID":"37775b30-b00f-4a53-9592-062c940e0516","Type":"ContainerStarted","Data":"7f48903f8531fa105a75a56ed01ee47aea4981c0e3e57eb5ba98fad43fc6661f"} Sep 18 13:09:37.037940 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:37.037591 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:09:37.039154 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:37.039131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" event={"ID":"61d7dd94-3915-4a0b-80da-99f1d230f32c","Type":"ContainerStarted","Data":"5a0b02d7cd794f07380e9c028a62659137150f44fca7048f2e7ab7d7688ddd94"} Sep 18 13:09:37.039274 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:37.039219 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:37.076073 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:37.076021 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" podStartSLOduration=1.264358329 podStartE2EDuration="5.076006877s" totalImagesPullingTime="3.811648548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:37.074722131 +0000 UTC m=+441.212196100" watchObservedRunningTime="2026-09-18 13:09:37.076006877 +0000 UTC m=+441.213480843" Sep 18 13:09:37.115538 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:37.115486 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" podStartSLOduration=2.226155992 podStartE2EDuration="6.115468996s" totalImagesPullingTime="3.889313004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:37.113226777 +0000 UTC m=+441.250700743" watchObservedRunningTime="2026-09-18 13:09:37.115468996 +0000 UTC m=+441.252942978" Sep 18 13:09:39.499351 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.499265 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc"] Sep 18 13:09:39.501950 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.501928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.516895 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.516873 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wjbfr\"" Sep 18 13:09:39.517067 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.517055 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 18 13:09:39.517302 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.517291 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 18 13:09:39.522845 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.522828 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 18 13:09:39.556091 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.556062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.556256 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.556116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.556256 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.556179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.556256 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.556204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.556256 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.556242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.556459 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.556321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k9s9\" (UniqueName: \"kubernetes.io/projected/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-kube-api-access-5k9s9\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.556459 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.556348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.564441 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.564416 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc"] Sep 18 13:09:39.657718 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.657675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k9s9\" (UniqueName: \"kubernetes.io/projected/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-kube-api-access-5k9s9\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.657718 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.657719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.657946 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.657789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.657946 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.657852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.657946 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.657889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.657946 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.657919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.658256 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.657947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.658750 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.658720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.660169 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.660149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.660270 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.660247 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.660308 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.660297 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.660345 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.660318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.682848 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.682821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.685395 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.685362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k9s9\" (UniqueName: \"kubernetes.io/projected/fa31f145-1e4b-4ee0-a7e5-ae8ddc377111-kube-api-access-5k9s9\") pod \"istiod-openshift-gateway-5677ccb49b-zfbrc\" (UID: \"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:39.811316 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:39.811230 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:40.117826 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:40.117752 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc"] Sep 18 13:09:40.120629 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:09:40.120601 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa31f145_1e4b_4ee0_a7e5_ae8ddc377111.slice/crio-bcc9c4d20db4789cc29184db791fe6132b00682f18d6b05088843eb78b46bb3d WatchSource:0}: Error finding container bcc9c4d20db4789cc29184db791fe6132b00682f18d6b05088843eb78b46bb3d: Status 404 returned error can't find the container with id bcc9c4d20db4789cc29184db791fe6132b00682f18d6b05088843eb78b46bb3d Sep 18 13:09:41.066459 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:41.066414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" event={"ID":"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111","Type":"ContainerStarted","Data":"bcc9c4d20db4789cc29184db791fe6132b00682f18d6b05088843eb78b46bb3d"} Sep 18 13:09:42.320779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:42.320734 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:09:42.321156 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:42.320817 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:09:42.764554 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:42.764492 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:42.956648 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:42.956586 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:43.078478 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.078364 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" event={"ID":"fa31f145-1e4b-4ee0-a7e5-ae8ddc377111","Type":"ContainerStarted","Data":"5f3c0bf50a3eb7d11a4aa490574a70f03cc0ce652150831e43a729467a11ab28"} Sep 18 13:09:43.078642 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.078542 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:43.080308 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.080273 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-zfbrc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 18 13:09:43.080449 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.080332 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" podUID="fa31f145-1e4b-4ee0-a7e5-ae8ddc377111" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 13:09:43.194915 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.194847 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" podStartSLOduration=1.997143044 podStartE2EDuration="4.194826695s" totalImagesPullingTime="2.197683651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:09:43.194126969 +0000 UTC m=+447.331600937" watchObservedRunningTime="2026-09-18 13:09:43.194826695 +0000 UTC m=+447.332300663" Sep 18 13:09:43.198084 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.198050 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:43.539515 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.539457 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:43.708942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:43.708909 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:09:44.083896 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:44.083866 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfbrc" Sep 18 13:09:48.046154 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:48.046122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2s9bh" Sep 18 13:09:48.048282 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:09:48.048259 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vmfnt" Sep 18 13:10:05.352041 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.352007 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67c6b6f98c-6frc9"] Sep 18 13:10:05.368351 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.368319 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c6b6f98c-6frc9"] Sep 18 13:10:05.368545 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.368494 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.417839 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.417804 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:05.473371 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.473337 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:05.474474 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.474452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-trusted-ca-bundle\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.474594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.474494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-service-ca\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.474594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.474558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-serving-cert\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.474707 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.474593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9wf6\" (UniqueName: \"kubernetes.io/projected/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-kube-api-access-h9wf6\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.474707 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.474654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-config\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.474707 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.474679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-oauth-config\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.474861 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.474758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-oauth-serving-cert\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.575342 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.575302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-oauth-serving-cert\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.575521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.575366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-trusted-ca-bundle\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.575521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.575419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-service-ca\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.575521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.575465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-serving-cert\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.575521 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.575500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9wf6\" (UniqueName: \"kubernetes.io/projected/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-kube-api-access-h9wf6\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.575738 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.575530 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-config\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.575738 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.575552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-oauth-config\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.576148 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.576122 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-oauth-serving-cert\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.576251 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.576155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-service-ca\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.576372 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.576350 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-trusted-ca-bundle\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.576474 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.576354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-config\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.578038 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.578014 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-serving-cert\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.578132 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.578061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-console-oauth-config\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.583778 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.583755 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9wf6\" (UniqueName: \"kubernetes.io/projected/c5976fb9-3c58-4b9c-a16e-882dbd73fecb-kube-api-access-h9wf6\") pod \"console-67c6b6f98c-6frc9\" (UID: \"c5976fb9-3c58-4b9c-a16e-882dbd73fecb\") " pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.678199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.678085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:05.955070 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:05.955047 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c6b6f98c-6frc9"] Sep 18 13:10:05.957570 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:10:05.957542 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5976fb9_3c58_4b9c_a16e_882dbd73fecb.slice/crio-0f0881c7a477a5d9bb8b9c7062bcedc5a1b49d6bf2d7662453ccb18f7fbc1335 WatchSource:0}: Error finding container 0f0881c7a477a5d9bb8b9c7062bcedc5a1b49d6bf2d7662453ccb18f7fbc1335: Status 404 returned error can't find the container with id 0f0881c7a477a5d9bb8b9c7062bcedc5a1b49d6bf2d7662453ccb18f7fbc1335 Sep 18 13:10:06.187619 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:06.187580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c6b6f98c-6frc9" event={"ID":"c5976fb9-3c58-4b9c-a16e-882dbd73fecb","Type":"ContainerStarted","Data":"a1e9a73a621804fdb30e2dc0f5ed8bddbabd547cb03bd6e3c8e89bd0870fc24b"} Sep 18 13:10:06.187797 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:06.187636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c6b6f98c-6frc9" event={"ID":"c5976fb9-3c58-4b9c-a16e-882dbd73fecb","Type":"ContainerStarted","Data":"0f0881c7a477a5d9bb8b9c7062bcedc5a1b49d6bf2d7662453ccb18f7fbc1335"} Sep 18 13:10:06.207936 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:06.207825 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67c6b6f98c-6frc9" podStartSLOduration=1.20780994 podStartE2EDuration="1.20780994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:10:06.206009989 +0000 UTC m=+470.343483956" watchObservedRunningTime="2026-09-18 13:10:06.20780994 +0000 UTC m=+470.345283907" Sep 18 13:10:14.532588 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:14.532543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:15.678564 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:15.678520 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:15.678564 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:15.678579 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:15.683342 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:15.683316 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:16.242947 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:16.242914 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67c6b6f98c-6frc9" Sep 18 13:10:16.291202 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:16.291170 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749dcc69f7-vm48d"] Sep 18 13:10:16.386094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:16.386007 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:16.487100 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:16.487066 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:16.550973 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:16.550907 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:32.507889 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:32.507848 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:32.645849 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:32.645797 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:37.116057 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.116020 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz"] Sep 18 13:10:37.119289 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.119273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.121884 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.121862 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 13:10:37.122012 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.121883 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 13:10:37.122012 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.121922 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jvjx5\"" Sep 18 13:10:37.128959 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.128934 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz"] Sep 18 13:10:37.147504 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.147477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.147636 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.147512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqhxg\" (UniqueName: \"kubernetes.io/projected/0ad7894d-b505-4773-af15-1bf2fcfc1df4-kube-api-access-bqhxg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.147636 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.147596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.217003 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.216960 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg"] Sep 18 13:10:37.221174 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.221146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.231334 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.231312 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg"] Sep 18 13:10:37.248898 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.248861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.249032 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.248900 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqhxg\" (UniqueName: \"kubernetes.io/projected/0ad7894d-b505-4773-af15-1bf2fcfc1df4-kube-api-access-bqhxg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.249032 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.248950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.249032 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.249006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.249221 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.249030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t79f2\" (UniqueName: \"kubernetes.io/projected/55260cb8-7c5c-4784-8ded-cca1cd3cae23-kube-api-access-t79f2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.249221 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.249067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.249306 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.249289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.249344 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.249327 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.257424 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.257401 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqhxg\" (UniqueName: \"kubernetes.io/projected/0ad7894d-b505-4773-af15-1bf2fcfc1df4-kube-api-access-bqhxg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.319321 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.319280 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m"] Sep 18 13:10:37.322624 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.322603 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.331552 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.331531 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m"] Sep 18 13:10:37.349500 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.349476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.349626 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.349528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t79f2\" (UniqueName: \"kubernetes.io/projected/55260cb8-7c5c-4784-8ded-cca1cd3cae23-kube-api-access-t79f2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.349674 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.349630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.349674 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.349666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.349783 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.349693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.349837 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.349809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j56rw\" (UniqueName: \"kubernetes.io/projected/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-kube-api-access-j56rw\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.349887 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.349816 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.350017 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.350002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.358182 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.358157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t79f2\" (UniqueName: \"kubernetes.io/projected/55260cb8-7c5c-4784-8ded-cca1cd3cae23-kube-api-access-t79f2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.421121 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.421049 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh"] Sep 18 13:10:37.423527 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.423506 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.428800 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.428778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:37.434337 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.434314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh"] Sep 18 13:10:37.450754 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.450732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.450860 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.450774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.450915 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.450856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.450955 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.450911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wg9v\" (UniqueName: \"kubernetes.io/projected/b278733b-974f-451c-b773-bda65a34b0f5-kube-api-access-5wg9v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.451013 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.450960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.451223 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.451108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56rw\" (UniqueName: \"kubernetes.io/projected/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-kube-api-access-j56rw\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.451223 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.451176 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.451542 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.451250 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.462003 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.461979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j56rw\" (UniqueName: \"kubernetes.io/projected/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-kube-api-access-j56rw\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.530626 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.530590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:37.552287 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.552257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wg9v\" (UniqueName: \"kubernetes.io/projected/b278733b-974f-451c-b773-bda65a34b0f5-kube-api-access-5wg9v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.552465 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.552360 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.552465 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.552410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.552754 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.552730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.552824 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.552741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.561769 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.561734 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wg9v\" (UniqueName: \"kubernetes.io/projected/b278733b-974f-451c-b773-bda65a34b0f5-kube-api-access-5wg9v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.632587 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.632558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:37.709520 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.709493 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz"] Sep 18 13:10:37.711044 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:10:37.711011 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad7894d_b505_4773_af15_1bf2fcfc1df4.slice/crio-c88b33f1f6dd6a1bde85794232268d29a752827608c7915539dafd221adb20f6 WatchSource:0}: Error finding container c88b33f1f6dd6a1bde85794232268d29a752827608c7915539dafd221adb20f6: Status 404 returned error can't find the container with id c88b33f1f6dd6a1bde85794232268d29a752827608c7915539dafd221adb20f6 Sep 18 13:10:37.732881 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.732860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:37.803493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.803462 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg"] Sep 18 13:10:37.806613 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:10:37.806580 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55260cb8_7c5c_4784_8ded_cca1cd3cae23.slice/crio-b08eee9ba8b62c3ae81432a93ee00112a4ce43a7721850a2a4057eb2980c3174 WatchSource:0}: Error finding container b08eee9ba8b62c3ae81432a93ee00112a4ce43a7721850a2a4057eb2980c3174: Status 404 returned error can't find the container with id b08eee9ba8b62c3ae81432a93ee00112a4ce43a7721850a2a4057eb2980c3174 Sep 18 13:10:37.911409 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:37.911361 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m"] Sep 18 13:10:37.912620 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:10:37.912592 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112ca999_3f95_4c1d_bc64_7c3ed442f3c6.slice/crio-482c06f0b5da886de208496bfa5cc34322e7b5120d16f1a57975c109ae672802 WatchSource:0}: Error finding container 482c06f0b5da886de208496bfa5cc34322e7b5120d16f1a57975c109ae672802: Status 404 returned error can't find the container with id 482c06f0b5da886de208496bfa5cc34322e7b5120d16f1a57975c109ae672802 Sep 18 13:10:38.024706 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.024681 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh"] Sep 18 13:10:38.026712 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:10:38.026689 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb278733b_974f_451c_b773_bda65a34b0f5.slice/crio-31ba46d82e7d2cc2fd744999bc4c2e9d6976ec7a863fd2a820e41ebdbac7e2ba WatchSource:0}: Error finding container 31ba46d82e7d2cc2fd744999bc4c2e9d6976ec7a863fd2a820e41ebdbac7e2ba: Status 404 returned error can't find the container with id 31ba46d82e7d2cc2fd744999bc4c2e9d6976ec7a863fd2a820e41ebdbac7e2ba Sep 18 13:10:38.346599 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.346504 2580 generic.go:356] "Generic (PLEG): container finished" podID="b278733b-974f-451c-b773-bda65a34b0f5" containerID="85e1e58883b8aca84b5a6793c8b0084b6f96e82502846984390092b198e2fe34" exitCode=0 Sep 18 13:10:38.346599 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.346548 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" event={"ID":"b278733b-974f-451c-b773-bda65a34b0f5","Type":"ContainerDied","Data":"85e1e58883b8aca84b5a6793c8b0084b6f96e82502846984390092b198e2fe34"} Sep 18 13:10:38.347112 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.346601 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" event={"ID":"b278733b-974f-451c-b773-bda65a34b0f5","Type":"ContainerStarted","Data":"31ba46d82e7d2cc2fd744999bc4c2e9d6976ec7a863fd2a820e41ebdbac7e2ba"} Sep 18 13:10:38.348184 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.348160 2580 generic.go:356] "Generic (PLEG): container finished" podID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerID="c183c3b451d30f29789f0ebe04ca8a2dc7738fbd5f64ea5d7a10fd4b5f16462e" exitCode=0 Sep 18 13:10:38.348265 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.348245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" event={"ID":"112ca999-3f95-4c1d-bc64-7c3ed442f3c6","Type":"ContainerDied","Data":"c183c3b451d30f29789f0ebe04ca8a2dc7738fbd5f64ea5d7a10fd4b5f16462e"} Sep 18 13:10:38.348316 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.348290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" event={"ID":"112ca999-3f95-4c1d-bc64-7c3ed442f3c6","Type":"ContainerStarted","Data":"482c06f0b5da886de208496bfa5cc34322e7b5120d16f1a57975c109ae672802"} Sep 18 13:10:38.349980 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.349961 2580 generic.go:356] "Generic (PLEG): container finished" podID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerID="a21d12780f5c4f0dc0a0c3b5420af7aecf18ad935bcfb59dd11eaddd82cea5e7" exitCode=0 Sep 18 13:10:38.350084 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.350027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" event={"ID":"55260cb8-7c5c-4784-8ded-cca1cd3cae23","Type":"ContainerDied","Data":"a21d12780f5c4f0dc0a0c3b5420af7aecf18ad935bcfb59dd11eaddd82cea5e7"} Sep 18 13:10:38.350084 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.350063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" event={"ID":"55260cb8-7c5c-4784-8ded-cca1cd3cae23","Type":"ContainerStarted","Data":"b08eee9ba8b62c3ae81432a93ee00112a4ce43a7721850a2a4057eb2980c3174"} Sep 18 13:10:38.351658 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.351630 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerID="9955577caa80b8e8503691e108f5475b4e71eddefea85e56e05e297e85d4064f" exitCode=0 Sep 18 13:10:38.351761 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.351656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" event={"ID":"0ad7894d-b505-4773-af15-1bf2fcfc1df4","Type":"ContainerDied","Data":"9955577caa80b8e8503691e108f5475b4e71eddefea85e56e05e297e85d4064f"} Sep 18 13:10:38.351761 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:38.351698 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" event={"ID":"0ad7894d-b505-4773-af15-1bf2fcfc1df4","Type":"ContainerStarted","Data":"c88b33f1f6dd6a1bde85794232268d29a752827608c7915539dafd221adb20f6"} Sep 18 13:10:39.357889 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:39.357860 2580 generic.go:356] "Generic (PLEG): container finished" podID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerID="d7cec268e28b774651aec3de9fbd40cdc5f5e639ecc5744b855fb3969bd1e629" exitCode=0 Sep 18 13:10:39.358251 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:39.357947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" event={"ID":"55260cb8-7c5c-4784-8ded-cca1cd3cae23","Type":"ContainerDied","Data":"d7cec268e28b774651aec3de9fbd40cdc5f5e639ecc5744b855fb3969bd1e629"} Sep 18 13:10:39.359830 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:39.359811 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerID="059358f414085ed67e7a0d983f9b1f33bf04468ec68a4ca8f9a5ebe56898112b" exitCode=0 Sep 18 13:10:39.359922 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:39.359868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" event={"ID":"0ad7894d-b505-4773-af15-1bf2fcfc1df4","Type":"ContainerDied","Data":"059358f414085ed67e7a0d983f9b1f33bf04468ec68a4ca8f9a5ebe56898112b"} Sep 18 13:10:40.367556 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:40.367465 2580 generic.go:356] "Generic (PLEG): container finished" podID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerID="4c932fca24a81c40fbb687fe02638a683e302f29ac55a84e500f65f63ad6642a" exitCode=0 Sep 18 13:10:40.371840 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:40.370689 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerID="69e70197b7c52ac82e3a205d39d8e4070173229eb329d9c05cd9deb1e1871b98" exitCode=0 Sep 18 13:10:40.374305 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:40.374282 2580 generic.go:356] "Generic (PLEG): container finished" podID="b278733b-974f-451c-b773-bda65a34b0f5" containerID="acb0ff19403274dc862ce2afe50a2f099e0c596a6a277a84c308696a975007c5" exitCode=0 Sep 18 13:10:40.374537 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:40.374516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" event={"ID":"55260cb8-7c5c-4784-8ded-cca1cd3cae23","Type":"ContainerDied","Data":"4c932fca24a81c40fbb687fe02638a683e302f29ac55a84e500f65f63ad6642a"} Sep 18 13:10:40.374579 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:40.374559 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" event={"ID":"0ad7894d-b505-4773-af15-1bf2fcfc1df4","Type":"ContainerDied","Data":"69e70197b7c52ac82e3a205d39d8e4070173229eb329d9c05cd9deb1e1871b98"} Sep 18 13:10:40.374616 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:40.374578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" event={"ID":"b278733b-974f-451c-b773-bda65a34b0f5","Type":"ContainerDied","Data":"acb0ff19403274dc862ce2afe50a2f099e0c596a6a277a84c308696a975007c5"} Sep 18 13:10:41.310274 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.310232 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-749dcc69f7-vm48d" podUID="aaf41c00-d921-4ef3-b880-954878650d30" containerName="console" containerID="cri-o://3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef" gracePeriod=15 Sep 18 13:10:41.381262 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.381227 2580 generic.go:356] "Generic (PLEG): container finished" podID="b278733b-974f-451c-b773-bda65a34b0f5" containerID="9544aa927b93e6ecceed47d12fabbc155c643453e56fcd8ad3909690e4e2cd4f" exitCode=0 Sep 18 13:10:41.381627 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.381317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" event={"ID":"b278733b-974f-451c-b773-bda65a34b0f5","Type":"ContainerDied","Data":"9544aa927b93e6ecceed47d12fabbc155c643453e56fcd8ad3909690e4e2cd4f"} Sep 18 13:10:41.383158 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.383133 2580 generic.go:356] "Generic (PLEG): container finished" podID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerID="a105f7a0189be2d972ebe19194f194b800ef6a081d1b46bf2aed7b4e757d9c8d" exitCode=0 Sep 18 13:10:41.383268 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.383212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" event={"ID":"112ca999-3f95-4c1d-bc64-7c3ed442f3c6","Type":"ContainerDied","Data":"a105f7a0189be2d972ebe19194f194b800ef6a081d1b46bf2aed7b4e757d9c8d"} Sep 18 13:10:41.536823 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.536795 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:41.594712 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.594637 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqhxg\" (UniqueName: \"kubernetes.io/projected/0ad7894d-b505-4773-af15-1bf2fcfc1df4-kube-api-access-bqhxg\") pod \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " Sep 18 13:10:41.594712 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.594690 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-bundle\") pod \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " Sep 18 13:10:41.594922 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.594742 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-util\") pod \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\" (UID: \"0ad7894d-b505-4773-af15-1bf2fcfc1df4\") " Sep 18 13:10:41.595432 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.595406 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-bundle" (OuterVolumeSpecName: "bundle") pod "0ad7894d-b505-4773-af15-1bf2fcfc1df4" (UID: "0ad7894d-b505-4773-af15-1bf2fcfc1df4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:41.597248 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.597223 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad7894d-b505-4773-af15-1bf2fcfc1df4-kube-api-access-bqhxg" (OuterVolumeSpecName: "kube-api-access-bqhxg") pod "0ad7894d-b505-4773-af15-1bf2fcfc1df4" (UID: "0ad7894d-b505-4773-af15-1bf2fcfc1df4"). InnerVolumeSpecName "kube-api-access-bqhxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:10:41.600498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.600471 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-util" (OuterVolumeSpecName: "util") pod "0ad7894d-b505-4773-af15-1bf2fcfc1df4" (UID: "0ad7894d-b505-4773-af15-1bf2fcfc1df4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:41.608252 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.608230 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:41.610295 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.610277 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:10:41.695456 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695429 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-bundle\") pod \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " Sep 18 13:10:41.695631 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695478 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-oauth-config\") pod \"aaf41c00-d921-4ef3-b880-954878650d30\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " Sep 18 13:10:41.695631 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695513 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-console-config\") pod \"aaf41c00-d921-4ef3-b880-954878650d30\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " Sep 18 13:10:41.695631 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695543 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-trusted-ca-bundle\") pod \"aaf41c00-d921-4ef3-b880-954878650d30\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " Sep 18 13:10:41.695631 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695581 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-serving-cert\") pod \"aaf41c00-d921-4ef3-b880-954878650d30\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " Sep 18 13:10:41.695631 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695612 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwl7n\" (UniqueName: \"kubernetes.io/projected/aaf41c00-d921-4ef3-b880-954878650d30-kube-api-access-rwl7n\") pod \"aaf41c00-d921-4ef3-b880-954878650d30\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " Sep 18 13:10:41.695901 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695646 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-util\") pod \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " Sep 18 13:10:41.695901 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695669 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t79f2\" (UniqueName: \"kubernetes.io/projected/55260cb8-7c5c-4784-8ded-cca1cd3cae23-kube-api-access-t79f2\") pod \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\" (UID: \"55260cb8-7c5c-4784-8ded-cca1cd3cae23\") " Sep 18 13:10:41.695901 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695722 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-oauth-serving-cert\") pod \"aaf41c00-d921-4ef3-b880-954878650d30\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " Sep 18 13:10:41.695901 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.695748 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-service-ca\") pod \"aaf41c00-d921-4ef3-b880-954878650d30\" (UID: \"aaf41c00-d921-4ef3-b880-954878650d30\") " Sep 18 13:10:41.696088 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696016 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-bundle" (OuterVolumeSpecName: "bundle") pod "55260cb8-7c5c-4784-8ded-cca1cd3cae23" (UID: "55260cb8-7c5c-4784-8ded-cca1cd3cae23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:41.696088 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696038 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.696088 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696059 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqhxg\" (UniqueName: \"kubernetes.io/projected/0ad7894d-b505-4773-af15-1bf2fcfc1df4-kube-api-access-bqhxg\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.696088 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696074 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ad7894d-b505-4773-af15-1bf2fcfc1df4-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.696352 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696323 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aaf41c00-d921-4ef3-b880-954878650d30" (UID: "aaf41c00-d921-4ef3-b880-954878650d30"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:10:41.696637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696457 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-service-ca" (OuterVolumeSpecName: "service-ca") pod "aaf41c00-d921-4ef3-b880-954878650d30" (UID: "aaf41c00-d921-4ef3-b880-954878650d30"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:10:41.696637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696477 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aaf41c00-d921-4ef3-b880-954878650d30" (UID: "aaf41c00-d921-4ef3-b880-954878650d30"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:10:41.696637 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.696618 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-console-config" (OuterVolumeSpecName: "console-config") pod "aaf41c00-d921-4ef3-b880-954878650d30" (UID: "aaf41c00-d921-4ef3-b880-954878650d30"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:10:41.697804 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.697783 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aaf41c00-d921-4ef3-b880-954878650d30" (UID: "aaf41c00-d921-4ef3-b880-954878650d30"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:10:41.698211 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.698192 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aaf41c00-d921-4ef3-b880-954878650d30" (UID: "aaf41c00-d921-4ef3-b880-954878650d30"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 13:10:41.698268 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.698190 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55260cb8-7c5c-4784-8ded-cca1cd3cae23-kube-api-access-t79f2" (OuterVolumeSpecName: "kube-api-access-t79f2") pod "55260cb8-7c5c-4784-8ded-cca1cd3cae23" (UID: "55260cb8-7c5c-4784-8ded-cca1cd3cae23"). InnerVolumeSpecName "kube-api-access-t79f2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:10:41.698268 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.698211 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf41c00-d921-4ef3-b880-954878650d30-kube-api-access-rwl7n" (OuterVolumeSpecName: "kube-api-access-rwl7n") pod "aaf41c00-d921-4ef3-b880-954878650d30" (UID: "aaf41c00-d921-4ef3-b880-954878650d30"). InnerVolumeSpecName "kube-api-access-rwl7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:10:41.702441 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.702422 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-util" (OuterVolumeSpecName: "util") pod "55260cb8-7c5c-4784-8ded-cca1cd3cae23" (UID: "55260cb8-7c5c-4784-8ded-cca1cd3cae23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:41.797498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797456 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797494 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t79f2\" (UniqueName: \"kubernetes.io/projected/55260cb8-7c5c-4784-8ded-cca1cd3cae23-kube-api-access-t79f2\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797498 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797506 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-oauth-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797515 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-service-ca\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797524 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55260cb8-7c5c-4784-8ded-cca1cd3cae23-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797532 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-oauth-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797541 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-console-config\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797551 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf41c00-d921-4ef3-b880-954878650d30-trusted-ca-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797558 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf41c00-d921-4ef3-b880-954878650d30-console-serving-cert\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:41.797732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:41.797566 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwl7n\" (UniqueName: \"kubernetes.io/projected/aaf41c00-d921-4ef3-b880-954878650d30-kube-api-access-rwl7n\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:42.389843 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.389815 2580 generic.go:356] "Generic (PLEG): container finished" podID="aaf41c00-d921-4ef3-b880-954878650d30" containerID="3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef" exitCode=0 Sep 18 13:10:42.390188 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.389867 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749dcc69f7-vm48d" Sep 18 13:10:42.390188 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.389892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749dcc69f7-vm48d" event={"ID":"aaf41c00-d921-4ef3-b880-954878650d30","Type":"ContainerDied","Data":"3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef"} Sep 18 13:10:42.390188 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.389934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749dcc69f7-vm48d" event={"ID":"aaf41c00-d921-4ef3-b880-954878650d30","Type":"ContainerDied","Data":"ff41958787466075385d4f53e01dc8a4b9fb4e13e3c1de461a8d244cf772c1b9"} Sep 18 13:10:42.390188 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.389957 2580 scope.go:117] "RemoveContainer" containerID="3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef" Sep 18 13:10:42.392046 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.392002 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" event={"ID":"55260cb8-7c5c-4784-8ded-cca1cd3cae23","Type":"ContainerDied","Data":"b08eee9ba8b62c3ae81432a93ee00112a4ce43a7721850a2a4057eb2980c3174"} Sep 18 13:10:42.392146 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.392037 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62rjwg" Sep 18 13:10:42.392417 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.392045 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b08eee9ba8b62c3ae81432a93ee00112a4ce43a7721850a2a4057eb2980c3174" Sep 18 13:10:42.394919 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.394902 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" Sep 18 13:10:42.395017 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.394909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahj8kz" event={"ID":"0ad7894d-b505-4773-af15-1bf2fcfc1df4","Type":"ContainerDied","Data":"c88b33f1f6dd6a1bde85794232268d29a752827608c7915539dafd221adb20f6"} Sep 18 13:10:42.395017 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.394946 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c88b33f1f6dd6a1bde85794232268d29a752827608c7915539dafd221adb20f6" Sep 18 13:10:42.397597 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.397568 2580 generic.go:356] "Generic (PLEG): container finished" podID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerID="e7c7a7b14e5eb81a4bea699b6f3bd2415eae0efa1a4a0a56e10cb13262508201" exitCode=0 Sep 18 13:10:42.397670 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.397643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" event={"ID":"112ca999-3f95-4c1d-bc64-7c3ed442f3c6","Type":"ContainerDied","Data":"e7c7a7b14e5eb81a4bea699b6f3bd2415eae0efa1a4a0a56e10cb13262508201"} Sep 18 13:10:42.401439 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.401414 2580 scope.go:117] "RemoveContainer" containerID="3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef" Sep 18 13:10:42.401987 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:10:42.401963 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef\": container with ID starting with 3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef not found: ID does not exist" containerID="3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef" Sep 18 13:10:42.402064 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.401992 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef"} err="failed to get container status \"3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef\": rpc error: code = NotFound desc = could not find container \"3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef\": container with ID starting with 3d0b416adc708eaeab5589632681240982dc0871a7210262f26aa89ca38c65ef not found: ID does not exist" Sep 18 13:10:42.408203 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.408183 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749dcc69f7-vm48d"] Sep 18 13:10:42.412138 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.412116 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-749dcc69f7-vm48d"] Sep 18 13:10:42.525355 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.525330 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:42.603705 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.603635 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-util\") pod \"b278733b-974f-451c-b773-bda65a34b0f5\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " Sep 18 13:10:42.603705 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.603680 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wg9v\" (UniqueName: \"kubernetes.io/projected/b278733b-974f-451c-b773-bda65a34b0f5-kube-api-access-5wg9v\") pod \"b278733b-974f-451c-b773-bda65a34b0f5\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " Sep 18 13:10:42.603874 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.603739 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-bundle\") pod \"b278733b-974f-451c-b773-bda65a34b0f5\" (UID: \"b278733b-974f-451c-b773-bda65a34b0f5\") " Sep 18 13:10:42.604320 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.604291 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-bundle" (OuterVolumeSpecName: "bundle") pod "b278733b-974f-451c-b773-bda65a34b0f5" (UID: "b278733b-974f-451c-b773-bda65a34b0f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:42.605803 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.605776 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b278733b-974f-451c-b773-bda65a34b0f5-kube-api-access-5wg9v" (OuterVolumeSpecName: "kube-api-access-5wg9v") pod "b278733b-974f-451c-b773-bda65a34b0f5" (UID: "b278733b-974f-451c-b773-bda65a34b0f5"). InnerVolumeSpecName "kube-api-access-5wg9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:10:42.611853 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.611827 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-util" (OuterVolumeSpecName: "util") pod "b278733b-974f-451c-b773-bda65a34b0f5" (UID: "b278733b-974f-451c-b773-bda65a34b0f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:42.704910 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.704867 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:42.704910 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.704903 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wg9v\" (UniqueName: \"kubernetes.io/projected/b278733b-974f-451c-b773-bda65a34b0f5-kube-api-access-5wg9v\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:42.705119 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:42.704920 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b278733b-974f-451c-b773-bda65a34b0f5-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:43.405645 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.405618 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" Sep 18 13:10:43.406119 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.405652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckt2dh" event={"ID":"b278733b-974f-451c-b773-bda65a34b0f5","Type":"ContainerDied","Data":"31ba46d82e7d2cc2fd744999bc4c2e9d6976ec7a863fd2a820e41ebdbac7e2ba"} Sep 18 13:10:43.406119 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.405693 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31ba46d82e7d2cc2fd744999bc4c2e9d6976ec7a863fd2a820e41ebdbac7e2ba" Sep 18 13:10:43.526176 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.526142 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:43.613345 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.613309 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-bundle\") pod \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " Sep 18 13:10:43.613525 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.613352 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j56rw\" (UniqueName: \"kubernetes.io/projected/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-kube-api-access-j56rw\") pod \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " Sep 18 13:10:43.613525 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.613448 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-util\") pod \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\" (UID: \"112ca999-3f95-4c1d-bc64-7c3ed442f3c6\") " Sep 18 13:10:43.613932 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.613900 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-bundle" (OuterVolumeSpecName: "bundle") pod "112ca999-3f95-4c1d-bc64-7c3ed442f3c6" (UID: "112ca999-3f95-4c1d-bc64-7c3ed442f3c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:43.615451 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.615425 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-kube-api-access-j56rw" (OuterVolumeSpecName: "kube-api-access-j56rw") pod "112ca999-3f95-4c1d-bc64-7c3ed442f3c6" (UID: "112ca999-3f95-4c1d-bc64-7c3ed442f3c6"). InnerVolumeSpecName "kube-api-access-j56rw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:10:43.618117 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.618085 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-util" (OuterVolumeSpecName: "util") pod "112ca999-3f95-4c1d-bc64-7c3ed442f3c6" (UID: "112ca999-3f95-4c1d-bc64-7c3ed442f3c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 13:10:43.714919 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.714894 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-bundle\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:43.714919 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.714918 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j56rw\" (UniqueName: \"kubernetes.io/projected/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-kube-api-access-j56rw\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:43.715094 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:43.714929 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/112ca999-3f95-4c1d-bc64-7c3ed442f3c6-util\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:10:44.371668 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:44.371633 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf41c00-d921-4ef3-b880-954878650d30" path="/var/lib/kubelet/pods/aaf41c00-d921-4ef3-b880-954878650d30/volumes" Sep 18 13:10:44.412266 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:44.412236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" event={"ID":"112ca999-3f95-4c1d-bc64-7c3ed442f3c6","Type":"ContainerDied","Data":"482c06f0b5da886de208496bfa5cc34322e7b5120d16f1a57975c109ae672802"} Sep 18 13:10:44.412266 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:44.412254 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76b89m" Sep 18 13:10:44.412687 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:44.412279 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="482c06f0b5da886de208496bfa5cc34322e7b5120d16f1a57975c109ae672802" Sep 18 13:10:49.104719 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:49.104685 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:49.899889 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:49.899856 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:50.295340 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:50.295301 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:51.378373 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:51.378337 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:51.488242 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:51.488211 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:53.889820 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:53.889783 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:54.570341 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:54.570304 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:56.098018 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:56.097976 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:57.614324 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:57.614282 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:57.711688 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:57.711650 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:10:58.297287 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:10:58.297253 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:00.167183 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:00.167150 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:00.291317 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:00.291279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:01.696321 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:01.696290 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:01.891056 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:01.891027 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:04.295755 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:04.295717 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:04.393524 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:04.393489 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:04.676367 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:04.676279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:04.731481 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:04.731438 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:05.080020 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:05.079991 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:05.144441 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:05.144410 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:11.361300 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:11.361214 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:11.481883 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:11.481852 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:13.797019 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:13.796980 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:13.904467 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:13.904418 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:20.360975 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:20.360942 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:20.521262 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:20.521222 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:25.803732 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:25.803693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:26.024292 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:26.024244 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:26.238259 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:26.238226 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:26.417349 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:26.417311 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:32.808034 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:32.807993 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:34.223107 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:34.223073 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:35.377646 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:35.377608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:35.518196 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:35.518158 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:41.822220 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:41.822188 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:42.042169 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.042137 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:42.297423 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297363 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc"] Sep 18 13:11:42.297700 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297687 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerName="pull" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297701 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerName="pull" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297714 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerName="pull" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297719 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerName="pull" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297726 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerName="extract" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297732 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerName="extract" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297739 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf41c00-d921-4ef3-b880-954878650d30" containerName="console" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297744 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf41c00-d921-4ef3-b880-954878650d30" containerName="console" Sep 18 13:11:42.297751 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297752 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297758 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297765 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297770 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297777 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b278733b-974f-451c-b773-bda65a34b0f5" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297782 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b278733b-974f-451c-b773-bda65a34b0f5" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297790 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297794 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297800 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b278733b-974f-451c-b773-bda65a34b0f5" containerName="pull" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297805 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b278733b-974f-451c-b773-bda65a34b0f5" containerName="pull" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297828 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerName="pull" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297833 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerName="pull" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297840 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b278733b-974f-451c-b773-bda65a34b0f5" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297845 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b278733b-974f-451c-b773-bda65a34b0f5" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297850 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297855 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297861 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297866 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerName="util" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297915 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ad7894d-b505-4773-af15-1bf2fcfc1df4" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297922 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="55260cb8-7c5c-4784-8ded-cca1cd3cae23" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297930 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf41c00-d921-4ef3-b880-954878650d30" containerName="console" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297936 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="112ca999-3f95-4c1d-bc64-7c3ed442f3c6" containerName="extract" Sep 18 13:11:42.298026 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.297941 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b278733b-974f-451c-b773-bda65a34b0f5" containerName="extract" Sep 18 13:11:42.300742 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.300722 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.304175 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.304157 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pqddd\"" Sep 18 13:11:42.323664 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.323637 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc"] Sep 18 13:11:42.366342 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.366279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:42.444877 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.444846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445069 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.444894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445069 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.444913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445069 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.444945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445069 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.444961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw6qs\" (UniqueName: \"kubernetes.io/projected/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-kube-api-access-qw6qs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445069 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.445059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.445089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.445130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.445357 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.445183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546491 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546491 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546720 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546778 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw6qs\" (UniqueName: \"kubernetes.io/projected/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-kube-api-access-qw6qs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546835 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546835 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.546942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.547150 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.546973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.547354 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.547323 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.547582 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.547500 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.547670 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.547606 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.547670 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.547639 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.549311 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.549292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.549450 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.549433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.580207 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.580168 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.580332 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.580277 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw6qs\" (UniqueName: \"kubernetes.io/projected/1dd3e6f5-3659-46c8-8754-6c84a43e9e74-kube-api-access-qw6qs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vxjnc\" (UID: \"1dd3e6f5-3659-46c8-8754-6c84a43e9e74\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.582297 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.582267 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:42.610783 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.610753 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:42.917443 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:11:42.917414 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd3e6f5_3659_46c8_8754_6c84a43e9e74.slice/crio-19f95dda11ad4cdcedfe51ca99f3c0feae073bacc06e45f7a7b0dc5be01cba4a WatchSource:0}: Error finding container 19f95dda11ad4cdcedfe51ca99f3c0feae073bacc06e45f7a7b0dc5be01cba4a: Status 404 returned error can't find the container with id 19f95dda11ad4cdcedfe51ca99f3c0feae073bacc06e45f7a7b0dc5be01cba4a Sep 18 13:11:42.919567 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.919534 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:11:42.919645 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.919608 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:11:42.919645 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.919641 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:11:42.924875 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:42.924854 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc"] Sep 18 13:11:43.702602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:43.702560 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" event={"ID":"1dd3e6f5-3659-46c8-8754-6c84a43e9e74","Type":"ContainerStarted","Data":"b3350c8c8d4583e18ff79f6bc8c6e972102e09f6068e23d3ba2747661806b0d6"} Sep 18 13:11:43.702784 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:43.702622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" event={"ID":"1dd3e6f5-3659-46c8-8754-6c84a43e9e74","Type":"ContainerStarted","Data":"19f95dda11ad4cdcedfe51ca99f3c0feae073bacc06e45f7a7b0dc5be01cba4a"} Sep 18 13:11:43.755205 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:43.755154 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" podStartSLOduration=1.755139145 podStartE2EDuration="1.755139145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:11:43.754236789 +0000 UTC m=+567.891710766" watchObservedRunningTime="2026-09-18 13:11:43.755139145 +0000 UTC m=+567.892613108" Sep 18 13:11:44.611602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:44.611561 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:44.616298 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:44.616272 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:44.707664 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:44.707631 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:44.708629 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:44.708609 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:11:45.299341 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:45.299307 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:45.538331 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:45.538299 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:46.408007 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:46.407966 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:46.580662 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:46.580618 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:52.617809 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:52.617765 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:52.773676 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:52.773639 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:53.142340 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:53.142306 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:11:53.243017 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:11:53.242979 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:06.450066 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:06.450028 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:06.601889 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:06.601849 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:06.955662 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:06.955627 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:16.261022 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:16.260996 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:12:16.263636 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:16.263606 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:12:16.264817 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:16.264798 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:12:16.267594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:16.267580 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:12:19.258981 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:19.258945 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:19.363199 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:19.363169 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:23.982231 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:23.982195 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:26.428480 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:26.428447 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:26.628632 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:26.628599 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:26.728752 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:26.728704 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:27.063658 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:27.063560 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:30.195883 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:30.195848 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:30.339602 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:30.339573 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:12:49.653494 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:12:49.653397 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:00.126124 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:00.126075 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:00.237195 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:00.237128 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:01.620705 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:01.620657 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:01.714827 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:01.714798 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:01.809759 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:01.809724 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:02.454854 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.454816 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:02.565186 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.565148 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:02.657218 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.657188 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:02.748733 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.748651 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ng4hw"] Sep 18 13:13:02.752344 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.752320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:02.755241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.755213 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xw7sg\"" Sep 18 13:13:02.755807 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.755785 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 18 13:13:02.776708 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.776683 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ng4hw"] Sep 18 13:13:02.831459 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.831425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9296492b-5f83-48a2-805c-8339577435f9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ng4hw\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:02.831642 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.831514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtk5\" (UniqueName: \"kubernetes.io/projected/9296492b-5f83-48a2-805c-8339577435f9-kube-api-access-6gtk5\") pod \"payload-processing-5b54b7fbb7-ng4hw\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:02.932652 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.932613 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtk5\" (UniqueName: \"kubernetes.io/projected/9296492b-5f83-48a2-805c-8339577435f9-kube-api-access-6gtk5\") pod \"payload-processing-5b54b7fbb7-ng4hw\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:02.932844 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.932668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9296492b-5f83-48a2-805c-8339577435f9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ng4hw\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:02.933317 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.933295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9296492b-5f83-48a2-805c-8339577435f9-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ng4hw\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:02.946646 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:02.946614 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtk5\" (UniqueName: \"kubernetes.io/projected/9296492b-5f83-48a2-805c-8339577435f9-kube-api-access-6gtk5\") pod \"payload-processing-5b54b7fbb7-ng4hw\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:03.064754 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:03.064653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:03.340793 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:03.340766 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ng4hw"] Sep 18 13:13:03.342019 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:13:03.341990 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9296492b_5f83_48a2_805c_8339577435f9.slice/crio-72f4cecf41bd2c339ad0e136172c398b059a1e45d9fd0cc5562bc9c6459fb85a WatchSource:0}: Error finding container 72f4cecf41bd2c339ad0e136172c398b059a1e45d9fd0cc5562bc9c6459fb85a: Status 404 returned error can't find the container with id 72f4cecf41bd2c339ad0e136172c398b059a1e45d9fd0cc5562bc9c6459fb85a Sep 18 13:13:03.343947 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:03.343929 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:13:04.111942 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:04.111897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" event={"ID":"9296492b-5f83-48a2-805c-8339577435f9","Type":"ContainerStarted","Data":"72f4cecf41bd2c339ad0e136172c398b059a1e45d9fd0cc5562bc9c6459fb85a"} Sep 18 13:13:05.119290 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:05.119184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" event={"ID":"9296492b-5f83-48a2-805c-8339577435f9","Type":"ContainerStarted","Data":"323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58"} Sep 18 13:13:05.119290 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:05.119255 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:05.136668 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:05.136616 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" podStartSLOduration=1.7204234459999999 podStartE2EDuration="3.136596372s" totalImagesPullingTime="1.416172926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:13:05.136470011 +0000 UTC m=+649.273943978" watchObservedRunningTime="2026-09-18 13:13:05.136596372 +0000 UTC m=+649.274070334" Sep 18 13:13:12.174424 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:12.174369 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:12.273852 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:12.273816 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:13.162615 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:13.162583 2580 generic.go:356] "Generic (PLEG): container finished" podID="1dd3e6f5-3659-46c8-8754-6c84a43e9e74" containerID="b3350c8c8d4583e18ff79f6bc8c6e972102e09f6068e23d3ba2747661806b0d6" exitCode=0 Sep 18 13:13:13.162779 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:13.162651 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" event={"ID":"1dd3e6f5-3659-46c8-8754-6c84a43e9e74","Type":"ContainerDied","Data":"b3350c8c8d4583e18ff79f6bc8c6e972102e09f6068e23d3ba2747661806b0d6"} Sep 18 13:13:13.163112 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:13.163092 2580 scope.go:117] "RemoveContainer" containerID="b3350c8c8d4583e18ff79f6bc8c6e972102e09f6068e23d3ba2747661806b0d6" Sep 18 13:13:13.164130 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:13.164096 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:13:13.164228 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:13.164185 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:13:13.164294 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:13.164234 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 13:13:14.169901 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:14.169871 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" event={"ID":"1dd3e6f5-3659-46c8-8754-6c84a43e9e74","Type":"ContainerStarted","Data":"1230232e9ba53bc29f208cf39b5afb2ec604a18c54be75cd6ba089d3b315b516"} Sep 18 13:13:14.611713 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:14.611672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:13:14.612896 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:14.612869 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vxjnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Sep 18 13:13:14.613004 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:14.612925 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" podUID="1dd3e6f5-3659-46c8-8754-6c84a43e9e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Sep 18 13:13:14.708497 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:14.708458 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:13:15.611491 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:15.611452 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vxjnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Sep 18 13:13:15.611890 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:15.611510 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" podUID="1dd3e6f5-3659-46c8-8754-6c84a43e9e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Sep 18 13:13:16.126369 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:16.126335 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:13:16.611829 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:16.611792 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vxjnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Sep 18 13:13:16.612214 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:16.611852 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" podUID="1dd3e6f5-3659-46c8-8754-6c84a43e9e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Sep 18 13:13:17.611838 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:17.611794 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vxjnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Sep 18 13:13:17.612229 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:17.611871 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" podUID="1dd3e6f5-3659-46c8-8754-6c84a43e9e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Sep 18 13:13:18.611400 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:18.611343 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vxjnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Sep 18 13:13:18.611587 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:18.611429 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" podUID="1dd3e6f5-3659-46c8-8754-6c84a43e9e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Sep 18 13:13:19.631526 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:19.631487 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:13:19.632606 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:19.632583 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vxjnc" Sep 18 13:13:20.269174 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:20.269143 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:26.151115 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:26.151084 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:37.997000 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:37.996968 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:38.304591 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:38.304502 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:41.641953 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.641922 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p"] Sep 18 13:13:41.644178 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.644161 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.647040 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.647018 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 13:13:41.647040 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.647028 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w9t5d\"" Sep 18 13:13:41.648060 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.648040 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 13:13:41.648158 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.648108 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 18 13:13:41.658387 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.658354 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p"] Sep 18 13:13:41.674668 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.674643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.674762 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.674670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.674762 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.674692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.674762 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.674707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e89ad00f-7463-4baf-b7b6-2bca28e962f7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.674883 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.674804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zll\" (UniqueName: \"kubernetes.io/projected/e89ad00f-7463-4baf-b7b6-2bca28e962f7-kube-api-access-z4zll\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.674883 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.674862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.758590 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.758560 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:41.775481 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.775599 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.775599 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.775690 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e89ad00f-7463-4baf-b7b6-2bca28e962f7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.775748 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zll\" (UniqueName: \"kubernetes.io/projected/e89ad00f-7463-4baf-b7b6-2bca28e962f7-kube-api-access-z4zll\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.775748 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.775888 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.776002 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.775974 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.776061 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.776015 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.777681 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.777664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e89ad00f-7463-4baf-b7b6-2bca28e962f7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.778011 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.777995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e89ad00f-7463-4baf-b7b6-2bca28e962f7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.784814 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.784789 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zll\" (UniqueName: \"kubernetes.io/projected/e89ad00f-7463-4baf-b7b6-2bca28e962f7-kube-api-access-z4zll\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jd7p\" (UID: \"e89ad00f-7463-4baf-b7b6-2bca28e962f7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:41.954071 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:41.954031 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:42.224361 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:42.224333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p"] Sep 18 13:13:42.225420 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:13:42.225395 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89ad00f_7463_4baf_b7b6_2bca28e962f7.slice/crio-b63432a13467dde4134b79909175a160624e14de3dca0786db18dbf97dc9e6ab WatchSource:0}: Error finding container b63432a13467dde4134b79909175a160624e14de3dca0786db18dbf97dc9e6ab: Status 404 returned error can't find the container with id b63432a13467dde4134b79909175a160624e14de3dca0786db18dbf97dc9e6ab Sep 18 13:13:42.339862 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:42.339828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" event={"ID":"e89ad00f-7463-4baf-b7b6-2bca28e962f7","Type":"ContainerStarted","Data":"b63432a13467dde4134b79909175a160624e14de3dca0786db18dbf97dc9e6ab"} Sep 18 13:13:43.348191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:43.348142 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" event={"ID":"e89ad00f-7463-4baf-b7b6-2bca28e962f7","Type":"ContainerStarted","Data":"e5d76039fcc649795691d51484a695c7c1ea88e4cdf476f6253cb7f282a5fd40"} Sep 18 13:13:43.366997 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:43.366944 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" podStartSLOduration=1.436213982 podStartE2EDuration="2.366927816s" totalImagesPullingTime="930.713834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:13:43.366055755 +0000 UTC m=+687.503529736" watchObservedRunningTime="2026-09-18 13:13:43.366927816 +0000 UTC m=+687.504401783" Sep 18 13:13:45.638689 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:45.638643 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:50.172182 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:50.172147 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:13:51.955015 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:51.954965 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:51.955474 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:51.955060 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:51.973365 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:51.973328 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:13:52.406917 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:13:52.406833 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jd7p" Sep 18 13:14:00.579207 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:14:00.579165 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:14:04.452958 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:14:04.452918 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:14:33.790773 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:14:33.790732 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:15:00.146396 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:00.146343 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw"] Sep 18 13:15:00.148750 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:00.148727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw" Sep 18 13:15:00.151738 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:00.151681 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mjffh\"" Sep 18 13:15:00.155283 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:00.155260 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw"] Sep 18 13:15:00.160120 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:00.160099 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw" Sep 18 13:15:00.432799 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:00.432776 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw"] Sep 18 13:15:00.434450 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:15:00.434418 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10a3248_0be7_4a21_a763_1484b5a118ed.slice/crio-91539c8d87869f5e5912a11428ae133eda85c735bf190998eb9ebd235efea32a WatchSource:0}: Error finding container 91539c8d87869f5e5912a11428ae133eda85c735bf190998eb9ebd235efea32a: Status 404 returned error can't find the container with id 91539c8d87869f5e5912a11428ae133eda85c735bf190998eb9ebd235efea32a Sep 18 13:15:00.739614 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:00.739519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw" event={"ID":"d10a3248-0be7-4a21-a763-1484b5a118ed","Type":"ContainerStarted","Data":"91539c8d87869f5e5912a11428ae133eda85c735bf190998eb9ebd235efea32a"} Sep 18 13:15:03.757621 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:03.757577 2580 generic.go:356] "Generic (PLEG): container finished" podID="d10a3248-0be7-4a21-a763-1484b5a118ed" containerID="71508c2a36dd359cab8045364c19ad6d4087d8f0e8edd6fc0b6ffbd5b73739f5" exitCode=0 Sep 18 13:15:03.758028 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:03.757667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw" event={"ID":"d10a3248-0be7-4a21-a763-1484b5a118ed","Type":"ContainerDied","Data":"71508c2a36dd359cab8045364c19ad6d4087d8f0e8edd6fc0b6ffbd5b73739f5"} Sep 18 13:15:04.893601 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:04.893576 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw" Sep 18 13:15:05.770744 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:05.770713 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw" Sep 18 13:15:05.770744 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:05.770731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828955-rggpw" event={"ID":"d10a3248-0be7-4a21-a763-1484b5a118ed","Type":"ContainerDied","Data":"91539c8d87869f5e5912a11428ae133eda85c735bf190998eb9ebd235efea32a"} Sep 18 13:15:05.771087 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:05.770777 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91539c8d87869f5e5912a11428ae133eda85c735bf190998eb9ebd235efea32a" Sep 18 13:15:39.316113 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.316036 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:15:39.449438 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.449405 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ng4hw"] Sep 18 13:15:39.449634 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.449614 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" podUID="9296492b-5f83-48a2-805c-8339577435f9" containerName="payload-processing" containerID="cri-o://323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58" gracePeriod=30 Sep 18 13:15:39.492953 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.492921 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:15:39.586983 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.586907 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:15:39.697478 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.697445 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:15:39.808465 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.808425 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9296492b-5f83-48a2-805c-8339577435f9-plugins-config-volume\") pod \"9296492b-5f83-48a2-805c-8339577435f9\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " Sep 18 13:15:39.808465 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.808471 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gtk5\" (UniqueName: \"kubernetes.io/projected/9296492b-5f83-48a2-805c-8339577435f9-kube-api-access-6gtk5\") pod \"9296492b-5f83-48a2-805c-8339577435f9\" (UID: \"9296492b-5f83-48a2-805c-8339577435f9\") " Sep 18 13:15:39.808850 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.808826 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9296492b-5f83-48a2-805c-8339577435f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9296492b-5f83-48a2-805c-8339577435f9" (UID: "9296492b-5f83-48a2-805c-8339577435f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 13:15:39.810653 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.810631 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9296492b-5f83-48a2-805c-8339577435f9-kube-api-access-6gtk5" (OuterVolumeSpecName: "kube-api-access-6gtk5") pod "9296492b-5f83-48a2-805c-8339577435f9" (UID: "9296492b-5f83-48a2-805c-8339577435f9"). InnerVolumeSpecName "kube-api-access-6gtk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 13:15:39.909597 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.909519 2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9296492b-5f83-48a2-805c-8339577435f9-plugins-config-volume\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:15:39.909597 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.909549 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gtk5\" (UniqueName: \"kubernetes.io/projected/9296492b-5f83-48a2-805c-8339577435f9-kube-api-access-6gtk5\") on node \"ip-10-0-135-58.ec2.internal\" DevicePath \"\"" Sep 18 13:15:39.942830 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.942793 2580 generic.go:356] "Generic (PLEG): container finished" podID="9296492b-5f83-48a2-805c-8339577435f9" containerID="323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58" exitCode=0 Sep 18 13:15:39.942963 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.942841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" event={"ID":"9296492b-5f83-48a2-805c-8339577435f9","Type":"ContainerDied","Data":"323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58"} Sep 18 13:15:39.942963 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.942923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" event={"ID":"9296492b-5f83-48a2-805c-8339577435f9","Type":"ContainerDied","Data":"72f4cecf41bd2c339ad0e136172c398b059a1e45d9fd0cc5562bc9c6459fb85a"} Sep 18 13:15:39.942963 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.942854 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ng4hw" Sep 18 13:15:39.942963 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.942945 2580 scope.go:117] "RemoveContainer" containerID="323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58" Sep 18 13:15:39.952239 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.952223 2580 scope.go:117] "RemoveContainer" containerID="323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58" Sep 18 13:15:39.952507 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:15:39.952487 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58\": container with ID starting with 323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58 not found: ID does not exist" containerID="323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58" Sep 18 13:15:39.952582 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.952514 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58"} err="failed to get container status \"323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58\": rpc error: code = NotFound desc = could not find container \"323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58\": container with ID starting with 323025be7b7d9232d05edeb7195e0da1dc90fadb302e721142c2315d7290cf58 not found: ID does not exist" Sep 18 13:15:39.970599 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.970575 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ng4hw"] Sep 18 13:15:39.975823 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:39.975803 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ng4hw"] Sep 18 13:15:40.371682 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:40.371653 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9296492b-5f83-48a2-805c-8339577435f9" path="/var/lib/kubelet/pods/9296492b-5f83-48a2-805c-8339577435f9/volumes" Sep 18 13:15:53.209937 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.209900 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq"] Sep 18 13:15:53.210443 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.210216 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d10a3248-0be7-4a21-a763-1484b5a118ed" containerName="cleanup" Sep 18 13:15:53.210443 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.210226 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d10a3248-0be7-4a21-a763-1484b5a118ed" containerName="cleanup" Sep 18 13:15:53.210443 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.210238 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9296492b-5f83-48a2-805c-8339577435f9" containerName="payload-processing" Sep 18 13:15:53.210443 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.210244 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9296492b-5f83-48a2-805c-8339577435f9" containerName="payload-processing" Sep 18 13:15:53.210443 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.210293 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d10a3248-0be7-4a21-a763-1484b5a118ed" containerName="cleanup" Sep 18 13:15:53.210443 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.210301 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9296492b-5f83-48a2-805c-8339577435f9" containerName="payload-processing" Sep 18 13:15:53.212572 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.212552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:15:53.215351 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.215328 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-h7kpf\"" Sep 18 13:15:53.215496 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.215328 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 18 13:15:53.228565 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.228540 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq"] Sep 18 13:15:53.325763 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.325723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzlr2\" (UniqueName: \"kubernetes.io/projected/28db229a-52fe-44ae-b767-ec8187d0ea6a-kube-api-access-wzlr2\") pod \"ai-gateway-controller-76ccbbf98d-pqgqq\" (UID: \"28db229a-52fe-44ae-b767-ec8187d0ea6a\") " pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:15:53.426485 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.426453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzlr2\" (UniqueName: \"kubernetes.io/projected/28db229a-52fe-44ae-b767-ec8187d0ea6a-kube-api-access-wzlr2\") pod \"ai-gateway-controller-76ccbbf98d-pqgqq\" (UID: \"28db229a-52fe-44ae-b767-ec8187d0ea6a\") " pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:15:53.436249 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.436223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzlr2\" (UniqueName: \"kubernetes.io/projected/28db229a-52fe-44ae-b767-ec8187d0ea6a-kube-api-access-wzlr2\") pod \"ai-gateway-controller-76ccbbf98d-pqgqq\" (UID: \"28db229a-52fe-44ae-b767-ec8187d0ea6a\") " pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:15:53.522209 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.522132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:15:53.803527 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:53.803497 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq"] Sep 18 13:15:53.805778 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:15:53.805750 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28db229a_52fe_44ae_b767_ec8187d0ea6a.slice/crio-38fd94e7f020338aaeae6dadc108928f1d929ea65cc64d06030bc4e443e6833f WatchSource:0}: Error finding container 38fd94e7f020338aaeae6dadc108928f1d929ea65cc64d06030bc4e443e6833f: Status 404 returned error can't find the container with id 38fd94e7f020338aaeae6dadc108928f1d929ea65cc64d06030bc4e443e6833f Sep 18 13:15:54.017604 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:54.017565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" event={"ID":"28db229a-52fe-44ae-b767-ec8187d0ea6a","Type":"ContainerStarted","Data":"38fd94e7f020338aaeae6dadc108928f1d929ea65cc64d06030bc4e443e6833f"} Sep 18 13:15:57.035730 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:57.035693 2580 generic.go:356] "Generic (PLEG): container finished" podID="28db229a-52fe-44ae-b767-ec8187d0ea6a" containerID="d9126d9ed615266a3a22329f1bf75d91f9a267f1a9172eca72a8c62694645fb7" exitCode=2 Sep 18 13:15:57.036135 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:57.035746 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" event={"ID":"28db229a-52fe-44ae-b767-ec8187d0ea6a","Type":"ContainerDied","Data":"d9126d9ed615266a3a22329f1bf75d91f9a267f1a9172eca72a8c62694645fb7"} Sep 18 13:15:57.036135 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:57.035971 2580 scope.go:117] "RemoveContainer" containerID="d9126d9ed615266a3a22329f1bf75d91f9a267f1a9172eca72a8c62694645fb7" Sep 18 13:15:58.044034 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:58.043993 2580 generic.go:356] "Generic (PLEG): container finished" podID="28db229a-52fe-44ae-b767-ec8187d0ea6a" containerID="d41c01ae27d2e44d7341067ee37c9788a6968c8d9548e334f08eec85945382fc" exitCode=2 Sep 18 13:15:58.044034 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:58.044029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" event={"ID":"28db229a-52fe-44ae-b767-ec8187d0ea6a","Type":"ContainerDied","Data":"d41c01ae27d2e44d7341067ee37c9788a6968c8d9548e334f08eec85945382fc"} Sep 18 13:15:58.044594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:58.044098 2580 scope.go:117] "RemoveContainer" containerID="d9126d9ed615266a3a22329f1bf75d91f9a267f1a9172eca72a8c62694645fb7" Sep 18 13:15:58.044594 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:58.044298 2580 scope.go:117] "RemoveContainer" containerID="d41c01ae27d2e44d7341067ee37c9788a6968c8d9548e334f08eec85945382fc" Sep 18 13:15:58.044696 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:15:58.044587 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:15:59.051188 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:15:59.051155 2580 scope.go:117] "RemoveContainer" containerID="d41c01ae27d2e44d7341067ee37c9788a6968c8d9548e334f08eec85945382fc" Sep 18 13:15:59.051888 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:15:59.051337 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:16:03.522674 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:03.522641 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:16:03.523176 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:03.523054 2580 scope.go:117] "RemoveContainer" containerID="d41c01ae27d2e44d7341067ee37c9788a6968c8d9548e334f08eec85945382fc" Sep 18 13:16:03.523319 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:16:03.523294 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:16:13.523037 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:13.523000 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:16:13.523528 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:13.523402 2580 scope.go:117] "RemoveContainer" containerID="d41c01ae27d2e44d7341067ee37c9788a6968c8d9548e334f08eec85945382fc" Sep 18 13:16:14.130076 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:14.129988 2580 generic.go:356] "Generic (PLEG): container finished" podID="28db229a-52fe-44ae-b767-ec8187d0ea6a" containerID="69b0966921a483021c3284d11c987fb6cb0433af093ec66941e28b4b50261c2d" exitCode=2 Sep 18 13:16:14.130076 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:14.130052 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" event={"ID":"28db229a-52fe-44ae-b767-ec8187d0ea6a","Type":"ContainerDied","Data":"69b0966921a483021c3284d11c987fb6cb0433af093ec66941e28b4b50261c2d"} Sep 18 13:16:14.130297 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:14.130127 2580 scope.go:117] "RemoveContainer" containerID="d41c01ae27d2e44d7341067ee37c9788a6968c8d9548e334f08eec85945382fc" Sep 18 13:16:14.130499 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:14.130480 2580 scope.go:117] "RemoveContainer" containerID="69b0966921a483021c3284d11c987fb6cb0433af093ec66941e28b4b50261c2d" Sep 18 13:16:14.130742 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:16:14.130720 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:16:23.523297 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:23.523255 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:16:23.523738 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:23.523684 2580 scope.go:117] "RemoveContainer" containerID="69b0966921a483021c3284d11c987fb6cb0433af093ec66941e28b4b50261c2d" Sep 18 13:16:23.523934 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:16:23.523899 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:16:33.522483 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:33.522445 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:16:33.522982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:33.522833 2580 scope.go:117] "RemoveContainer" containerID="69b0966921a483021c3284d11c987fb6cb0433af093ec66941e28b4b50261c2d" Sep 18 13:16:33.523072 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:16:33.523047 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:16:36.116649 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:36.116611 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:16:37.325550 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:37.325519 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:16:44.366703 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:44.366668 2580 scope.go:117] "RemoveContainer" containerID="69b0966921a483021c3284d11c987fb6cb0433af093ec66941e28b4b50261c2d" Sep 18 13:16:45.290109 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:45.290023 2580 generic.go:356] "Generic (PLEG): container finished" podID="28db229a-52fe-44ae-b767-ec8187d0ea6a" containerID="410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2" exitCode=2 Sep 18 13:16:45.290109 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:45.290095 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" event={"ID":"28db229a-52fe-44ae-b767-ec8187d0ea6a","Type":"ContainerDied","Data":"410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2"} Sep 18 13:16:45.290298 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:45.290161 2580 scope.go:117] "RemoveContainer" containerID="69b0966921a483021c3284d11c987fb6cb0433af093ec66941e28b4b50261c2d" Sep 18 13:16:45.290528 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:45.290502 2580 scope.go:117] "RemoveContainer" containerID="410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2" Sep 18 13:16:45.290759 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:16:45.290737 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:16:53.522968 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:53.522924 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:16:53.523485 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:53.523000 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:16:53.523485 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:16:53.523348 2580 scope.go:117] "RemoveContainer" containerID="410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2" Sep 18 13:16:53.523614 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:16:53.523592 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:17:08.371999 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:08.371972 2580 scope.go:117] "RemoveContainer" containerID="410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2" Sep 18 13:17:08.372431 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:17:08.372177 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:17:16.300146 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:16.300066 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:17:16.300146 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:16.300077 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gtdt2_fcf9db84-4ad1-480d-8fd7-c2e7e398a118/ovn-acl-logging/0.log" Sep 18 13:17:16.304178 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:16.304155 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:17:16.304300 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:16.304277 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:17:19.366852 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:19.366821 2580 scope.go:117] "RemoveContainer" containerID="410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2" Sep 18 13:17:19.367307 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:17:19.366989 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:17:33.367093 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:33.367052 2580 scope.go:117] "RemoveContainer" containerID="410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2" Sep 18 13:17:34.546531 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:34.546497 2580 generic.go:356] "Generic (PLEG): container finished" podID="28db229a-52fe-44ae-b767-ec8187d0ea6a" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" exitCode=2 Sep 18 13:17:34.546943 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:34.546545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" event={"ID":"28db229a-52fe-44ae-b767-ec8187d0ea6a","Type":"ContainerDied","Data":"16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575"} Sep 18 13:17:34.546943 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:34.546594 2580 scope.go:117] "RemoveContainer" containerID="410a2d9050d942058931c36003e6f685bc803e84bfc6ff11452d6c7b95ac7fa2" Sep 18 13:17:34.546943 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:34.546894 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:17:34.547157 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:17:34.547132 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:17:43.522280 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:43.522248 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:17:43.522760 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:43.522585 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:17:43.522803 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:17:43.522784 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:17:53.522996 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:53.522955 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:17:53.523536 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:17:53.523404 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:17:53.523648 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:17:53.523627 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:18:05.366191 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:05.366162 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:18:05.366572 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:18:05.366340 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:18:17.366666 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:17.366625 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:18:17.368895 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:18:17.366867 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:18:31.366689 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:31.366658 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:18:31.367213 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:18:31.366867 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:18:32.621470 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:32.621434 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:18:44.367284 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:44.367204 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:18:44.367765 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:18:44.367440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:18:53.906886 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:53.906847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:18:54.007192 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:54.007156 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:18:57.163013 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:57.162980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xk4hx_7b5ceb81-c3da-43c5-ab32-1f4c9bdd6c84/global-pull-secret-syncer/0.log" Sep 18 13:18:57.219873 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:57.219843 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" Sep 18 13:18:57.340870 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:57.340844 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-58.ec2.internal_45537bdadd91aa4ed68a329a28653edb/haproxy/0.log" Sep 18 13:18:59.366316 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:59.366284 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:18:59.366717 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:59.366601 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 13:18:59.990462 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:59.990428 2580 generic.go:356] "Generic (PLEG): container finished" podID="28db229a-52fe-44ae-b767-ec8187d0ea6a" containerID="c34365ab5fe6c848c80b128c20a8b0e2c35be26900666a8050218efb52e4bce2" exitCode=2 Sep 18 13:18:59.990609 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:59.990504 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" event={"ID":"28db229a-52fe-44ae-b767-ec8187d0ea6a","Type":"ContainerDied","Data":"c34365ab5fe6c848c80b128c20a8b0e2c35be26900666a8050218efb52e4bce2"} Sep 18 13:18:59.990609 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:59.990591 2580 scope.go:117] "RemoveContainer" containerID="16722317e1f2417305a45f01b030844344ad77c3e9491807c0678182b873b575" Sep 18 13:18:59.990910 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:18:59.990891 2580 scope.go:117] "RemoveContainer" containerID="c34365ab5fe6c848c80b128c20a8b0e2c35be26900666a8050218efb52e4bce2" Sep 18 13:18:59.991135 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:18:59.991115 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:19:03.523276 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:03.523230 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:19:03.523786 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:03.523648 2580 scope.go:117] "RemoveContainer" containerID="c34365ab5fe6c848c80b128c20a8b0e2c35be26900666a8050218efb52e4bce2" Sep 18 13:19:03.523890 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:19:03.523869 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:19:03.748556 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:03.748498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f2n4x_818ae179-eb0b-48ce-b01e-bb4c6eee9cbd/node-exporter/0.log" Sep 18 13:19:03.778533 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:03.778467 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f2n4x_818ae179-eb0b-48ce-b01e-bb4c6eee9cbd/kube-rbac-proxy/0.log" Sep 18 13:19:03.815241 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:03.815217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f2n4x_818ae179-eb0b-48ce-b01e-bb4c6eee9cbd/init-textfile/0.log" Sep 18 13:19:04.151625 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.151546 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af11d09d-c86f-4c7a-97a3-9a92d6319f58/prometheus/0.log" Sep 18 13:19:04.177022 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.176998 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af11d09d-c86f-4c7a-97a3-9a92d6319f58/config-reloader/0.log" Sep 18 13:19:04.203752 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.203724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af11d09d-c86f-4c7a-97a3-9a92d6319f58/thanos-sidecar/0.log" Sep 18 13:19:04.234316 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.234288 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af11d09d-c86f-4c7a-97a3-9a92d6319f58/kube-rbac-proxy-web/0.log" Sep 18 13:19:04.263727 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.263698 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af11d09d-c86f-4c7a-97a3-9a92d6319f58/kube-rbac-proxy/0.log" Sep 18 13:19:04.288641 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.288610 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af11d09d-c86f-4c7a-97a3-9a92d6319f58/kube-rbac-proxy-thanos/0.log" Sep 18 13:19:04.319728 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.319707 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af11d09d-c86f-4c7a-97a3-9a92d6319f58/init-config-reloader/0.log" Sep 18 13:19:04.445035 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.445001 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cf599d4bd-vfwsm_bd6f3708-93d3-4a49-9b5d-905bdd831e31/telemeter-client/0.log" Sep 18 13:19:04.469208 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.469185 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cf599d4bd-vfwsm_bd6f3708-93d3-4a49-9b5d-905bdd831e31/reload/0.log" Sep 18 13:19:04.497022 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:04.496998 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cf599d4bd-vfwsm_bd6f3708-93d3-4a49-9b5d-905bdd831e31/kube-rbac-proxy/0.log" Sep 18 13:19:05.085964 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:05.085884 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-trnv5_2c0c60e4-3608-4a1e-aca1-61ad7ebad995/konnectivity-agent/0.log" limit=1024 Sep 18 13:19:07.196370 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.196341 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67c6b6f98c-6frc9_c5976fb9-3c58-4b9c-a16e-882dbd73fecb/console/0.log" Sep 18 13:19:07.310755 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.310725 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp"] Sep 18 13:19:07.315353 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.315332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.317842 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.317807 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nnzqh\"/\"openshift-service-ca.crt\"" Sep 18 13:19:07.317962 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.317930 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nnzqh\"/\"default-dockercfg-9hvc7\"" Sep 18 13:19:07.318039 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.318023 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nnzqh\"/\"kube-root-ca.crt\"" Sep 18 13:19:07.326230 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.326208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp"] Sep 18 13:19:07.387455 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.387418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-podres\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.387622 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.387473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g79m7\" (UniqueName: \"kubernetes.io/projected/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-kube-api-access-g79m7\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.387622 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.387544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-proc\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.387622 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.387580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-sys\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.387622 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.387611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-lib-modules\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488766 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-lib-modules\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488766 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-podres\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488766 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g79m7\" (UniqueName: \"kubernetes.io/projected/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-kube-api-access-g79m7\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-proc\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-sys\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-lib-modules\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-podres\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488897 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-proc\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.488982 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.488926 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-sys\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.496742 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.496718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g79m7\" (UniqueName: \"kubernetes.io/projected/fee5d7f5-35a5-4723-b65c-cf3f58a480aa-kube-api-access-g79m7\") pod \"perf-node-gather-daemonset-ksfsp\" (UID: \"fee5d7f5-35a5-4723-b65c-cf3f58a480aa\") " pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.625114 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.625077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:07.919493 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:07.919461 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp"] Sep 18 13:19:07.920096 ip-10-0-135-58 kubenswrapper[2580]: W0918 13:19:07.920064 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfee5d7f5_35a5_4723_b65c_cf3f58a480aa.slice/crio-5f0e2694a3316ceade689ae18f9d78d3a261c36dd4ed6ea97364fe09943a4b1e WatchSource:0}: Error finding container 5f0e2694a3316ceade689ae18f9d78d3a261c36dd4ed6ea97364fe09943a4b1e: Status 404 returned error can't find the container with id 5f0e2694a3316ceade689ae18f9d78d3a261c36dd4ed6ea97364fe09943a4b1e Sep 18 13:19:08.033230 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:08.033193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" event={"ID":"fee5d7f5-35a5-4723-b65c-cf3f58a480aa","Type":"ContainerStarted","Data":"73e67069baaa14bf1db61d0e902ad463d3521131dc46c850d77860a945bbe95b"} Sep 18 13:19:08.033424 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:08.033246 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" event={"ID":"fee5d7f5-35a5-4723-b65c-cf3f58a480aa","Type":"ContainerStarted","Data":"5f0e2694a3316ceade689ae18f9d78d3a261c36dd4ed6ea97364fe09943a4b1e"} Sep 18 13:19:08.033424 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:08.033293 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:08.053411 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:08.053342 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" podStartSLOduration=1.053327492 podStartE2EDuration="1.053327492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:19:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:08.051896939 +0000 UTC m=+1012.189370906" watchObservedRunningTime="2026-09-18 13:19:08.053327492 +0000 UTC m=+1012.190801459" Sep 18 13:19:09.167221 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:09.167189 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fm2lz_b538f319-13b1-4273-bb7c-c281a510a49d/dns/0.log" Sep 18 13:19:09.190369 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:09.190343 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fm2lz_b538f319-13b1-4273-bb7c-c281a510a49d/kube-rbac-proxy/0.log" Sep 18 13:19:09.339815 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:09.339786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d4hdl_d9a9fbfa-749e-4750-8c3d-8c40386a7efb/dns-node-resolver/0.log" Sep 18 13:19:09.940923 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:09.940893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4tsjm_4acaf024-1e02-4de1-9906-e8ba4bc9b112/node-ca/0.log" Sep 18 13:19:10.943013 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:10.942986 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k_4d0f9097-ae43-470d-bdab-2e6ff704c6ca/istio-proxy/0.log" Sep 18 13:19:11.000799 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:11.000772 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zfbrc_fa31f145-1e4b-4ee0-a7e5-ae8ddc377111/discovery/0.log" Sep 18 13:19:11.109368 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:11.109337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vxjnc_1dd3e6f5-3659-46c8-8754-6c84a43e9e74/istio-proxy/1.log" Sep 18 13:19:11.109686 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:11.109671 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vxjnc_1dd3e6f5-3659-46c8-8754-6c84a43e9e74/istio-proxy/0.log" Sep 18 13:19:11.777674 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:11.777643 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nwjk9_9d9dccf0-6fa5-4103-97cd-56d71a40823e/serve-healthcheck-canary/0.log" Sep 18 13:19:12.464197 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:12.464164 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jj6gh_1b2abd9c-a1ee-426a-a211-a7b560938d92/kube-rbac-proxy/0.log" Sep 18 13:19:12.488831 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:12.488808 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jj6gh_1b2abd9c-a1ee-426a-a211-a7b560938d92/exporter/0.log" Sep 18 13:19:12.515298 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:12.515272 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jj6gh_1b2abd9c-a1ee-426a-a211-a7b560938d92/extractor/0.log" Sep 18 13:19:13.522555 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:13.522514 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" Sep 18 13:19:13.523044 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:13.522951 2580 scope.go:117] "RemoveContainer" containerID="c34365ab5fe6c848c80b128c20a8b0e2c35be26900666a8050218efb52e4bce2" Sep 18 13:19:13.523204 ip-10-0-135-58 kubenswrapper[2580]: E0918 13:19:13.523183 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=ai-gateway-controller-76ccbbf98d-pqgqq_opendatahub(28db229a-52fe-44ae-b767-ec8187d0ea6a)\"" pod="opendatahub/ai-gateway-controller-76ccbbf98d-pqgqq" podUID="28db229a-52fe-44ae-b767-ec8187d0ea6a" Sep 18 13:19:14.048525 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:14.048495 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nnzqh/perf-node-gather-daemonset-ksfsp" Sep 18 13:19:14.799306 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:14.799277 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-76ccbbf98d-pqgqq_28db229a-52fe-44ae-b767-ec8187d0ea6a/manager/5.log" Sep 18 13:19:14.799306 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:14.799293 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-76ccbbf98d-pqgqq_28db229a-52fe-44ae-b767-ec8187d0ea6a/manager/5.log" Sep 18 13:19:14.905912 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:14.905887 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vmfnt_37775b30-b00f-4a53-9592-062c940e0516/server/0.log" Sep 18 13:19:14.949829 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:14.949800 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2s9bh_61d7dd94-3915-4a0b-80da-99f1d230f32c/manager/0.log" Sep 18 13:19:14.973899 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:14.973878 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57ff796844-4wb2z_e53bac64-210e-47eb-8f30-422ef6868ae3/manager/0.log" Sep 18 13:19:14.994620 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:14.994599 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57ff796844-4wb2z_e53bac64-210e-47eb-8f30-422ef6868ae3/copy-manifests/0.log" Sep 18 13:19:16.378427 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:16.378400 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b4c5b8666-c6hhs_3ab7b323-bfdb-4401-8582-a442998aceea/manager/0.log" Sep 18 13:19:17.152265 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:17.152186 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k_4d0f9097-ae43-470d-bdab-2e6ff704c6ca/istio-proxy/0.log" Sep 18 13:19:17.190878 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:17.190847 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zfbrc_fa31f145-1e4b-4ee0-a7e5-ae8ddc377111/discovery/0.log" Sep 18 13:19:17.246004 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:17.245976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vxjnc_1dd3e6f5-3659-46c8-8754-6c84a43e9e74/istio-proxy/1.log" Sep 18 13:19:17.246584 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:17.246565 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vxjnc_1dd3e6f5-3659-46c8-8754-6c84a43e9e74/istio-proxy/0.log" Sep 18 13:19:18.265426 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:18.265395 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fwq2k_4d0f9097-ae43-470d-bdab-2e6ff704c6ca/istio-proxy/0.log" Sep 18 13:19:18.306556 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:18.306530 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zfbrc_fa31f145-1e4b-4ee0-a7e5-ae8ddc377111/discovery/0.log" Sep 18 13:19:18.358411 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:18.358365 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vxjnc_1dd3e6f5-3659-46c8-8754-6c84a43e9e74/istio-proxy/1.log" Sep 18 13:19:18.358691 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:18.358675 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vxjnc_1dd3e6f5-3659-46c8-8754-6c84a43e9e74/istio-proxy/0.log" Sep 18 13:19:23.157160 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.157129 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/1.log" Sep 18 13:19:23.164160 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.164141 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hfnw_27a05597-0b30-4d86-a40f-743c7965b10a/kube-multus/2.log" Sep 18 13:19:23.575807 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.575776 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbtmh_cdec71bb-9c86-42bd-b2e8-0a83c1d221a2/kube-multus-additional-cni-plugins/0.log" Sep 18 13:19:23.599354 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.599326 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbtmh_cdec71bb-9c86-42bd-b2e8-0a83c1d221a2/egress-router-binary-copy/0.log" Sep 18 13:19:23.622323 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.622299 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbtmh_cdec71bb-9c86-42bd-b2e8-0a83c1d221a2/cni-plugins/0.log" Sep 18 13:19:23.645196 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.645175 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbtmh_cdec71bb-9c86-42bd-b2e8-0a83c1d221a2/bond-cni-plugin/0.log" Sep 18 13:19:23.668344 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.668319 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbtmh_cdec71bb-9c86-42bd-b2e8-0a83c1d221a2/routeoverride-cni/0.log" Sep 18 13:19:23.693655 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.693634 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbtmh_cdec71bb-9c86-42bd-b2e8-0a83c1d221a2/whereabouts-cni-bincopy/0.log" Sep 18 13:19:23.717161 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.717137 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sbtmh_cdec71bb-9c86-42bd-b2e8-0a83c1d221a2/whereabouts-cni/0.log" Sep 18 13:19:23.873894 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.873810 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hwp4v_fa2fbfeb-7084-4c33-a604-24123f4420e9/network-metrics-daemon/0.log" Sep 18 13:19:23.894417 ip-10-0-135-58 kubenswrapper[2580]: I0918 13:19:23.894391 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hwp4v_fa2fbfeb-7084-4c33-a604-24123f4420e9/kube-rbac-proxy/0.log"